Technical development of the first Basic Registry of Identified Global Entities (BRIDGE) release is currently about a half-way to completion. If you have been following the project you will know that BRIDGE aims to revolutionize data interoperability in the global social sector by uniquely identifying all the world’s NGOs in one database. Read on to find out what’s new.
Considering its ambitious scope, the project it has unfolded as efficiently as we could have hoped for, given that it’s dependent on collaboration between four distinct partner organizations—Foundation Center, GlobalGiving, GuideStar, and TechSoup Global—represented by contributing team members on both sides of the Atlantic, who are in turn coordinating with a Polish software development firm, all the while consulting with a technical advisory group composed of six extremely busy specialists and sector thought leaders—themselves spanning three countries. Nonetheless, I am happy to report that the foundation of BRIDGE has been laid and we are making steady progress.
From its inception, BRIDGE has been conceived of as something that will have the potential for unexpected positive outcomes.
Just as no one involved in the creation of Universal Product Codes (UPCs) in the 1970’s could have anticipated or planned for the development of the current crop of smart phone scanner apps, we expect BRIDGE to provide a foundation for future innovation but we don’t yet know precisely where that will take us. We know BRIDGE will have far-reaching implications, perhaps revolutionizing philanthropic information-sharing, but we can only begin to imagine the breadth of the project’s ultimate impact.
In recognition (or perhaps even celebration) of this, we have built flexibility into both the process and the product. For example, we are using the Scrum Agile software development methodology—a process which allows for on-the-fly adaptations and adjustments. Agile is particularly well suited to a project such as BRIDGE where we know generally what we want to accomplish and the unmet needs we want to serve, but we don’t necessarily know precisely how everything will fit together in the end. This is in contrast to more traditional ways of building things, such as an actual bridge, for example, for which explicit and largely static specifications about the end product are necessary to have in hand before any work can begin.
The creation of BRIDGE has been a balancing act between flexibility and decisiveness. We have prioritized the big decisions so we may preserve our future capacity to accommodate unanticipated needs while still maintaining a coherent overarching vision. So far this approach has led us to develop a cloud-based non-relational (NoSQL) database utilizing open source technologies. For now, even the BRIDGE numbering system itself—which aims to assign every nonprofit and NGO, as well as their programs and projects, and other social sector entities across the globe a unique identifier, like a numerical fingerprint—will be basically unstructured so as to allow for maximum future flexibility and scalability. The selection of a non-relational database will allow BRIDGE to easily scale up as it grows larger and larger. Developing such a flexible system removes any limit to the ultimate size of the database while preserving performance speeds. It also potentially will allow us to better accommodate currently unforeseen and less structured data varieties with an eye towards the emergence of Big Data in the social sector.
Being globally hosted in the cloud will also be a great advantage to BRIDGE. Being cloud-based means we can continually grow without needing to invest in physical hardware infrastructure upfront. If we need more capacity we can automatically allow for it; if we don’t, we don’t even have to pay for it. It also means the database will be fast and reliable anytime from anywhere in the world that there is a decent Internet connection. Ultimately, being in the global data cloud is ideal for BRIDGE, not just from a technical standpoint but also metaphorically as the project becomes an international tool for use by anyone seeking to improve collaboration and communication in the social sector—from Patagonia to Siberia and beyond.
Okay, enough with the grandiose platitudes, let’s get wonky for a moment. Here is an overview of what has been accomplished to date (and I promise a translation will follow):
- Creation & configuration of the MongoDB database, development of the BRIDGE data schema and importation of the initial sample data from each of the core team member organizations
- Development of the initial API functions, basic user interface and BRIDGE ID generation mechanisms
- Creation & tuning of the data de-duplication process and matching algorithm, including geo-coding, addresses normalization, threshold generation and fuzzy matching
- Implementation of data indexing & retrieval through ElasticSearch
- Configuration & deployment of test systems to Amazon cloud servers
In plain English, what this all means is that the infrastructure of BRIDGE has been delivered and the first iterations of the most important initial features of the system have been created and are now in the process of being tested, tuned and refined. The core structure is there, and now we just have to make it function exceptionally well. And that’s exactly what we will be doing over the course of the next few months. We will create and deploy the first iteration of the secure user interfaces that the core team member organizations will begin using for in-depth testing of the tool. In addition we are going to create a user management system and perform several improvements to the API layer. Most critically, perhaps, is that we expect to spend a lot of time focusing on deeply customizing the de-duplication process to the specific needs and idiosyncrasies of the global social sector.
In human terms, BRIDGE is a vital cog in the greater mission to change lives. It is a platform that will, at minimum, allow us to answer simple but perennially vexing questions that stunt effective intervention, such as: Who’s doing what–and where? Are our efforts too concentrated or not concentrated enough in specific geographies–on specific problems? Beyond these, the exciting thing is that we can begin to generate new uses, tools and insights as the platform matures and many people worldwide put it to their particular uses.