The Story of AllMusic, Which Predates the World Wide Web

The story of AllMusic, an amazing music encyclopedia.

Here’s an excerpt from MotherBoard’s article:
“Every band, every artist, in every genre, gets a biography. Every album, single, EP, and live album that gets a release, no matter how obscure, is catalogued, and AllMusic tries its damndest to review them all, too. AllMusic has quietly become the kind of resource that’s so intrinsic to the internet that it’s hard to imagine the internet without it.”


Knowledge Protection

The song of destruction. Fire. Torrents of water. Earthquakes. More fire.

Entire libraries, unique works of art, and countless other artifacts of our knowledge and heritage have been destroyed during natural disasters. Examples of our helplessness facing the gigantic forces of cataclysms are legion throughout history.

The song of destruction. Bullets. Shells. Mortar rounds. Rockets. Bombs. Fire.

Conflicts have perhaps been the most destructive forces against our heritage. We human beings have a long, shameful tradition of trying to erase entire populations from history by destroying their cultures. Of course nazi Germany is probably the first example that comes to mind, but let’s not forget all the wars, ethnic cleansings and genocides before that. The Library of Alexandria being torched, Bagdad under siege by the Mongols are famous examples of our tendency to let stupidity and brutality destroy wisdom and knowledge.
The destruction of knowledge committed by the nazis (and, as collateral damages of bombings, by Allied forces) has been quite well documented, for example in The Rape Of Europa, contrary to the damages inflicted by more recent conflicts, which haven’t been thoroughly investigated, despite the fact that a wide variety of independent medias have been covering these wars extensively.
The talibans infamously destroyed the Bamiyan Buddhas; the Khmer Rouge burned down every single library they could find. Right now, the Islamic State, the Syrian Army and other groups (most of them loosely affiliated with Al-Qaeda or other extremist organizations) are destroying and plundering archeological sites in Syria and Iraq – profiting from the sale of the stolen, but unfortunately mostly scientifically destroyed artifacts (an artifact taken out of its archeological context – strata, etc… is mostly useless for scientific research). These crimes aren’t prosecuted (of course it’s rather difficult when the entire region is deep inside a sectarian conflict), and if it weren’t for the courageous and outstanding work of men like Cheikmous Ali and his non profit APSA, which documents heritage destruction in Syria, we wouldn’t even know about them in the first place.

ISIS Destroying world heritage_76161278_isis-statue-composite
Islamic State fighters destroying a 3,000 years old Assyrian statue excavated from the Tell Ajaja site

For those of you who speak/understand french, the german-french TV station Arte made a great documentary on how stolen artifacts sold in the West are financing terrorism in the Middle East, which features APSA’s work in Syria.

If you weren’t convinced yet, I hope you now realize humanity’s collective heritage is and has always been threatened by conflicts, natural disasters or just sheer stupidity. We just cannot tolerate that in a modern, civilized world. It is both terrible for our history and for our knowledge – we won’t have any other chance to learn things from destroyed artifacts. This quote from Matthew Bogdanos’ excellent book Thieves of Baghdad (a man who witnessed knowledge destruction and eventually became a specialist in retrieving stolen artifacts and protecting them while serving in the US military in Iraq) nicely sums up the tragedy of heritage looting and destruction: “The Rockefeller Wing of the Met contains a treasure trove of antiquities from Peru. But how did they get there? It is well-known that looting has ravaged Peru for decades. In other regions, [like Syria and Iraq right now] looting is destroying sites as soon as they are discovered, crushing any hope of learning about previously unknown cultures.”


What can be done about this?
Since the end of WWII most armies have internal guidelines to not attack cultural sites, something the United Nations also tries to address with the Blue Shield program. Basically, blue shields, literally, are painted on the buildings which are to be spared from air strikes and heavy shelling. However recent examples show these initiatives aren’t sufficient, in part because most conflicts aren’t fought only by national armies but by rebel groups too, which aren’t complying with international laws, and also because the international community doesn’t care about this issue at all. The UNESCO witnessed the plundering and destruction of World Heritage Sites in Syria without flinching, cynically classifying the Syrian sites as “threatened” after the fact.
The United Nations, despite its great ideals, is totally incapable of maintaining peace, and prefers seminars, conferences and committees to actually getting people on the ground to protect civilians and heritage sites. What is needed is a real international army, like the Blue Helmets but with the power to engage in combat when it is necessary (and not just as self defense) to protect cultural sites. (As a side note, to protect civilians, the Blue Helmets need to be deployable swiftly wherever there are conflicts and be allowed to use deadly force whenever they see fit. Right now deploying Blue Helmets is a long and complex bureaucratic mess. It ought to be simple. If a conflict threatens civilians and if the Blue Helmets can make a difference, they should be deployed.)

In practice, it would mean having personnels guarding museums, libraries, and monuments in war zones. The Bamiyan Buddhas could have been saved if the talibans had met resistance from an international military force. Likewise, if the archeological sites in Syria and Iraq were protected, plundering wouldn’t take place there. As the Blue Shield is already an existing program, I’ll call this international military unit the Blue Shield Force.
The Blue Shield Force would be composed of volunteers (not necessarily from the military) who would be trained by powerful armies (NATO members for example) and then deployed around the world to protect endangered heritage sites. It is important that these people volunteer, that protecting knowledge is their choice, because in case of casualties, the blame won’t be on the governments for irresponsibly sending troops to protect “some rocks”. Avoiding such PR disasters for governments is important to ensure they participate in the Blue Shield Force.
To decide which sites should be protected, a group of international experts (librarians, archeologists, historians…) would propose and vote on potential targets. The Blue Shield Force command team would then decide how many men to send there and how to equip them, in cooperation with the experts to make sure the response is appropriate.
Like the Blue Helmets the Blue Shield Force would be financed by the UN, but also by private donors – if people want to donate to help protect our collective heritage, they ought to be able to do so.
Unfortunately most countries are unlikely to commit resources to protect knowledge. However, a side benefit of knowledge protection could encourage them to fund the Blue Shield Force: by preventing plundering, the Blue Shield Force would dramatically reduce art trafficking and thus cut a major source of revenues for terrorist organizations like the Islamic State.

The Blue Shield Force is essential in order to protect our cultural heritage during conflicts. In peace time, natural disasters and “natural” decay are the main threats to our heritage. Fortunately, libraries are getting digitized at an accelerating pace, and we can expect to have digital backups of most of our texts rather soon. Monuments, on the other hand, are more difficult to preserve.  A non profit called CyArk is using lasers to digitize entire buildings which is a great way to have a very detailed view of the monument in case it is damaged by some hazardous weather or by a conflict later on.

A combination of the Blue Shield Force, to protect our cultural heritage during conflicts, and of non profits like CyArk, to digitize it before a conflict or a natural disaster has a chance to destroy it, is a pretty solid insurance policy against time.

Furthermore, those who destroy or attempt to destroy our heritage should be prosecuted. Burning an important library is an odious crime. Destroying a World Heritage Site or other monuments internationally recognized as important for all humankind should be tried as a crime against humanity.

The destruction of the Bamiyan Buddhas falls into the latter category. No one in the taliban was prosecuted for it. Every single senior taliban official responsible for this crime is still at large. The Mullah Omar, as the leader of the talibans ordered the Buddhas to be destroyed. He’s hiding somewhere in Pakistan. However as the top commander of the talibs, he might one day suffer the same fate as Usama Bin Laden. Wakil Ahmed Muttawakil, former Foreign Minister of the talibans, is a free man living in Kabul. At the time of the Buddhas’ destruction, he said: “We do admit all these statues were the cultural heritage of Afghanistan, but we will not leave the part which is contrary to our belief.” The whereabouts of former Information Minister Qudratullah Jamal aren’t known, but he is presumably still alive and at large too.
Talibans’ spokesman Rahmatullah Hashemi, who defended the destruction of the Buddhas during an interview with Charlie Rose in 2001, is now working at the “Peace Research Institute Oslo” (PRIO), in Norway. He seems to have changed his mind about the talibans, and has left the group since at least 2004-2005. Still, even if he now condemns the destruction of the Buddhas (which, without public statements from him, cannot be verified), he was involved in it as a senior official of the regime. His responsibility in this crime should be decided by an International Court. Requests for an interview with Hashemi went unanswered.

Hashemi's page on the PRIO website (
Hashemi’s page on the PRIO website (

Interpol ought to have a division in charge of these kinds of crimes. They already have people working on stolen art and heritage, like Syrian artifacts or art stolen by the nazis, but they suffer from a terrible lack of resources and people to be capable of really hitting art trafficking hard. It is crucial to truly fund an investigation unit assigned to find and prosecute people who commit crimes against our cultural heritage, as well as fight against art trafficking and try to curtail it as much as possible. For the latter, tough sanctions on auction houses like Sotheby’s which sell artifacts from dubious provenances could be a good deterrent. A moratorium on selling Syrian artifacts is needed right now.


So in a nutshell, here’s the plan to protect our knowledge as much as possible from our stupidity and from natural disasters: prevention via restoration and digitization, protection with the Blue Shield Force, and prosecution with an Interpol “Blue Shield Group”.
In the (very) long term though, we can hope to have to rely on the Blue Shield Force and the Interpol Blue Shield Group less and less – that is, if we can offer an affordable, humanist and secular education to most of the world’s population. Truly educated people don’t destroy knowledge.

When will we see a real Universal Library?

All of humanity’s knowledge at your fingertips. This promise sounds familiar – this is how a lot of people describe the internet. Indeed, we have unprecedented access to tons of information, and we need search engines to help us navigate this ocean of data. However, even if Google, Bing, DuckDuckGo and others are getting better at directly answering our questions, we can’t get access to all human knowledge on the internet yet. Wikipedia is “just” a summary of our knowledge; to access all of it, we need to be able to read every single book, article, journal, etc… ever published. Access to all of humanity’s knowledge means access to humanity’s entire scientific (and non-scientific) literature. Even if we have access to movies, songs, either legally or not, with the likes of Netflix, Spotify, or The Pirate Bay, access to books is much more restrained, even if some websites such as the Russian Library Genesis or the late are prototypes of what a modern Universal Library could look like. Library Genesis, the only one of these sites still up, isn’t without its flaws, and is a bit confidential – it doesn’t come close to the title of Universal Library -, but it’s a good first step.
What should a Universal Library be like? What’s holding us back? How can we build one?

“Knowledge is of two kinds. We know a subject ourselves, or we know where we can find information upon it.” — Samuel Johnson
A Universal Library is a representation of science. Gathering all human knowledge in one place creates a monolithic artefact I call the Universal Library. It contains all of what Popper called the third world or world three: all of humankind’s literature.
As Popper said, “instead of growing better memories and brains, we grow paper, pens, pencils, typewriters, dictaphones, the printing press, and libraries.”, yet today brain-enhancing tools like libraries are scattered around the globe, and are (academic libraries especially) inaccessible for most of us. The Universal Library is the ultimate tool we can create in order to store and retrieve all of our knowledge easily.
This is perhaps the only artefact we should send to an extraterrestrial civilization, the sum of all human knowledge. Such an artefact doesn’t exist today.
It is also our ultimate legacy. We have to make sure all our knowledge can survive our own existence. Like the monoliths in 2001: A Space Odyssey, which could have been created by a long extinct civilization, our Universal Library will have to still exist and be readable even if we disappear, just in case other intelligent beings stumble upon it.
L’Encyclopédie, perhaps the single most important book of the Enlightenment, was written with this sense of “urgency”. It was designed as The Book, the only book to preserve in the case of a global cataclysm if we were to preserve (most of, since the Encyclopédie was obviously a summary) our knowledge.
In a sense, books replaced cathedrals as mankind’s most enduring creation. Victor Hugo even wrote that “architecture will never again be the social, the collective, the dominant art. The great epic, the great monument, the great master-piece of mankind will never again be built; it will be printed.” Many compare scientific research to cathedral-building, likening the scientists, each publishing papers on a particular topic, to the masons adding stones to a particular part of a cathedral. (For example, Popper wrote: “All work in science is work directed towards the growth of objective knowledge. We are workers who are adding to the growth of objective knowledge as masons work on a cathedral.”)
Just like cathedrals were meant to last for millennia and took decades to be built, science transcends our existence as individuals; in As We May Think, Vannevar Bush wrote that “science has provided the swiftest communication between individuals; it has provided a record of ideas and has enabled man to manipulate and to make extracts from that record so that knowledge evolves and endures throughout the life of a race rather than that of an individual.”
Access to this “record”, as Bush called it, should be a human right. Every individual on this planet, no matter how much he earns or where he lives, should be able to read everything anyone ever published.
Yet fragmented access and storage of mankind’s literature make using and preserving our legacy difficult. Hence the idea of a Universal Library.

Having everything that’s ever been written (and published) all stored in one place isn’t a new idea, but it was always extremely costly and difficult to set up in the past due to technological limitations, which is why all the attempts at setting up universal libraries have failed.
From clay tablets to the Web, each new technology in publishing allowed more knowledge to be stored and disseminated more cheaply and easily. The amount of information we were able to store and the cost of access to this information respectively increased and decreased exponentially. It is mind boggling to imagine the difference between clay tablet encyclopedias, reserved to the Sumerian elite, and Wikipedia, accessible anywhere on Earth for anyone with an internet connection or a cellphone.
The most famous innovation/revolution in publishing is arguably the printing press, which industrialized knowledge dissemination and conservation: books were no longer scarce and expensive; the scientific community grew exponentially and thrived in all of the developed world thanks to cheap access to scientific works, and mass-education was made possible.
The cheap and easy copying of books made possible by the printing press enabled more texts to be preserved, since many different copies could be stored in different locations, and reprinted at will. With the printing press, the physical book didn’t matter anymore. Only the information it contained did (this is even more true with digital texts now). Hugo also referred to this revolution in preservation, writing “Under the form of printing, thought is more imperishable than ever; it is volatile, intangible, indestructible”.
The modern Universal Library will be the next revolution. The internet allows many copies of the Universal Library to be made by both institutions and individuals, so that preservation won’t be an issue. As Time journalist Michael Scherer put it: “The internet is Gutenberg on steroids, a printing press without ink, overhead or delivery costs”.

Yet the internet isn’t seen this way by publishers. They still behave like books are a “scarce” commodity, while the internet allows unlimited distribution of books for free. If the publishers really embraced the internet, they would publish their books/journals for free, instead of charging exorbitant amounts of money for pdfs.
Such resistance to change isn’t new. In its infancy, – in the 1500s and even in the 1600s – the printing press wasn’t recognized as the best tool to distribute knowledge more broadly and easily. In his Novum Organum (110), Bacon talked about those who didn’t acknowledge the superiority of the printing press over hand-copied books: “For however the discovery of gunpowder, silk, the compass, sugar, paper, or the like, may appear to depend on peculiar properties of things and nature, printing at least involves no contrivance which is not clear and almost obvious. But from want of observing that although the arrangement of the types of letters required more trouble than writing with the hand, yet these types once arranged serve for innumerable impressions, while manuscript only affords one copy; […] this most beautiful invention (which assists so materially the propagation of learning) remained unknown for so many ages.” So yes, the transition from copying by hand to the printing press wasn’t immediate. It took the actions of individuals (in this case, publishers) to bring this technology to the mainstream. With the internet, these individuals won’t be publishers. They will be programmers, “pirates”, hackers, amateurs, people who care about knowledge and its dissemination and want all human knowledge to be at the fingertips of everybody.

The most famous attempt at setting up a Universal Library was arguably the Library of Alexandria. Though it probably was the largest and richest library of its time, it never was a universal library, but was meant to become one, acquiring as many books as possible, and making them available to scholars from different regions of the mediterranean. Just imagine what it meant at the time to be able to browse through the stacks of the library, through thousands of manuscripts from around the (known) world, to be able to let your mind wander among the knowledge of entire civilizations! Such unprecedented access allowed the scholars of Alexandria to make remarkable discoveries that would have been impossible without the ressources of the Library. Unfortunately, the Library was completely destroyed by fire.
In China, an early fifteenth-century encyclopedia called the Yongle dadian ran to more than 10,000 volumes. It was so expensive to print that very few copies were made. Less than 4 percent of it has survived.
Books are fragile. When they are rare, or unique, a single fire, storm, earthquake, can wipe them out of the surface of the Earth. Even books for which hundreds of copies exist can disappear with time, wars, or natural disasters…
The internet offers us a new and unique opportunity to preserve all of them. An internet Universal Library could be easily copied on hard drives placed in safes, and allowing users to get their own copies of the books they consult will create even more numerous back ups.
Of course this method isn’t immune to everything. Hackers and malevolent governments and corporations would try to destroy the modern Universal Library. Time and decay could corrupt the hard drives the Library is stored on. However, the whole point of having an internet Universal Library is decentralization. In other words, there would be so many copies of it that it would be nearly impossible to destroy (and along with the preservation of the physical books, there would be a physical backup just in case… ). With offline backups, users’ backups, and many copies stored on state of the art servers in different locations, it would be very tough to destroy the modern Universal Library.

Another weakness of physical libraries that would be addressed by the Universal Library is the one of access. In the past, only noblemen and bourgeois had access to knowledge, because they could afford to learn to read and could be allowed in universities which had libraries. Though some libraries allowed more people than others, like the Ambrosiana in Milan in the early seventeenth-century, which seemed to be open to basically anyone who asked, the individual’s location and wealth were still key to his access to libraries. If you had the chance to live in Milan you could have visited the Ambrosiana, but if you were in rural Italy and not rich enough to afford the trip, you were basically out of luck.
This is still the main impediment to access to libraries. Not a lot of Americans can have easy access to the Library of Congress. Most of the world’s population lives in places where libraries are small, poor, or more often inexistant. If in theory most of the libraries across the globe don’t put restrictions on who can access them based on one’s wealth or social status, they are still mostly inaccessible and can’t offer many ressources.
On the other hand, an internet Universal Library, while by definition offering as many ressources as possible (everything that’s ever been published, no less), is accessible to anyone with an internet connection through a cyber-café, a personal computer or a cellphone. Of course billions of people lack access to the internet, but I’m hopeful the internet will reach them soon enough – at least before libraries reach them, for sure…

When you are lucky enough to have access to a library, it does a pretty terrible job at helping you navigate the maze of information we are faced with now. They of course only let you search through their catalog, since searching on another library’s catalog wouldn’t be very useful if you can’t access the physical books…but what about all the other books out there, those which aren’t in the library’s catalog?
Even when there wasn’t as many literature as nowadays, people needed tools to guide them through the forest of publications. That was one of the purposes of encyclopedias. Now in the twenty-first century we have search engines run by powerful algorithms, but they’re not quite good enough yet.
Google is a great tool, but it doesn’t have access to everything – scholarly publications especially are locked inside publishers’ databases and are behind paywalls – if you want to really get a good look at most of the literature, you have to switch between multiple tools: Google, Elsevier, Wiley, Springer’s databases, etc… It’s a very time consuming process the Universal Library should make fast and simple.

Before we look at what the modern Universal Library should look like, let me take a moment to address the issue of copyright and of the publishers retaining it. If the Universal Library is to give free access to all human literature, this is likely going to be quite an issue.
I am going to focus on the scientific literature here – though most of the outrageous publishing environment (abusive corporations, lengthy copyright) applies to non-scientific publishing as well -.
So, publishers. The “big three” (Wiley, Springer, Elsevier) and a few others retain a monopoly on scientific publications, and behave like a cartel, making deals to not compete with one another (just look at their prices, which are kept very high and are the same for all the different publishers). As they refuse to compete, they are very unlikely to change their business model. I’m surprised they haven’t been under investigation for antitrust… As they have the copyrights of most of the scientific publications in circulation, they can charge sky-high prices for simple pdfs, and they are quick to call “pirate” anyone who tries to make these papers more available. “Pirate” is a word linked to brutality, theft and blood. But in publishing, pirates are hardly what you would normally call criminals. There were pirates from the beginning of the publishing business. What were and are they still doing? Refusing to respect the copyright monopoly in order to make publications more affordable. That is much less brutal than boarding a ship and massacring all its crew, right? Furthermore, pirates served an essential role by publishing censored works (like those of Newton!), which “respectable” publishing houses were too scared to print. In publishing, a pirate is a person or corporation which makes publications more affordable or just available in the first place. The scholar Adrian Johns, in his amazing book Piracy takes his reader to the historical roots of “piracy”, explaining the pirate reprint industry like this: “A Dickens novel might appear first in a good-quality reprint by Carey or some other respectable firm; then a cheap piracy of that reprint; then in chapbooks, then in serialized forms; then in provincial newspapers; then in 25 cents “railroad” editions; and finally as chapters printed on railway timetables. As this happened, distinctions between propriety and transgression became increasingly blurred. Reprinters who ignored the courtesies issued popular works in enormous quantities and at very low prices. A five-volume Macaulay appeared in sixty thousand copies, at 15 cents per volume. Reprinters also issued science (Liebig’s Chemistry) in impressions well into the tens of thousands. And just as Careys and Harpers justified their own reproductions as moral enterprises, so these “pirates” (as Carey called them) openly defended theirs as exemplifying republican values. Here, after all, was an endeavor that distributed improving literature and authoritative ideas in unprecedented quantities and at extraordinarily low prices. It arguably did more to make America a truly lettered republic than any number of polite Philadelphia publications. It was in monarchial England, one pirate observed, that special societies had to be created to push useful knowledge out; here, entrepreneurs of knowledge responded to the pull of the masses.”
Did you know that publishers even tried to outlaw libraries? They argued that if people could read books for free, no one would buy any new books, and thus no one would write books anymore. This was in the late eighteenth to mid nineteenth century. Publishers lost their fight against libraries, and as we know, no one wrote a book since 1850, right?
Today they fight against file-sharers who make their publications available for free online, like Their argument is still completely ridiculous, just as it was in 1850, but with the corrupt governments we have now, they are winning the legal battle against file-sharing (though hopefully technology won’t let them win the war). Tom Reller from Elsevier, which relies on libraries subscribing to its publications for most of its revenues, said: “We can’t allow published journal articles to be freely accessible on a large scale – especially not through other for-profit companies, who want to benefit from our and other publishers’ efforts. What library will continue to subscribe if a growing proportion of articles is available for free elsewhere?”. So basically, people shouldn’t have access to knowledge, even though it’s technologically absolutely possible, because it could hurt the big publishing multinationals.
I can imagine Shell, Exxon or BP saying the same thing about, say, electric cars: “If people buy electric cars, who will buy our oil?” Technological progress is not here to please corporations but to advance the human race. If we can have clean, electric transportation, that’s a progress, and if it kills the oil giants, so be it. If we can have free access to knowledge on the internet, that’s a progress, and if it kills the publishing giants, so be it. As Peter Murray-Rust said, “Publishers should be the servants of knowledge – at present they are becoming the tyrants.”
So when we face a big, inefficient (I ordered a book on neurology from Springer in February, it’s out of print and there isn’t an ebook version – I have yet to receive it – : a chance I am not a doctor needing some vital information for a patient…) and monopolistic system, our best course of action is to rebel. To follow Aaron Swartz’s Guerilla Open Access Manifesto, to liberate all this knowledge. To make all scientific literature available online for free. That’s basically the definition of the modern Universal Library.

Making all these publications available for free would violate copyright law. A law that has been invented to create a monopoly for publishers. This law has no moral basis, just like a law prohibiting people from buying electric cars to preserve the oil industry.
Copyright law is supposed to be about property. However property is based on scarcity, and there is no such thing as scarcity with electronic files. If you take my car, I don’t have a car anymore. If you make a copy of my ebook, I still have my ebook. Stephan Kinsella wrote a great book on this topic, Against Intellectual Property. In it he gives a very libertarian view of this issue, which is the only reasonable one: “Only tangible, scarce ressources are the possible object of interpersonal conflict, so it is only for them that property rules are applicable. Thus, patents and copyrights are unjustifiable monopolies granted by government legislation.”
As there cannot be conflict over things of infinite abundance, property rights cannot apply to them. Thus copyright is untenable.

Now that the issue of copyright is settled, that we have looked a bit into the historical roots of the idea of a Universal Library and at the book technologies throughout history, let’s see what a modern Universal Library should look like.
Two quotes to begin with:
“There are worse crimes than burning books. One of them is not reading them.” — Joseph Brodsky
“Free Libraries for every soul.” — Melvil Dewey

-Access to every book, article; everything that’s ever been published: The modern Universal Library needs to be the repository of all humankind’s knowledge, thus of everything man has ever published. This will allow scattered publications (for example, in scientific publishing articles on any topic appear on a very large number of publications, making tracking every one of them difficult) to be gathered in one place.
Search will be made orders of magnitude more simple, since you’ll only have to search one database to embrace the whole of human knowledge.

-Open APIs: users ought to be able to build on top of the Universal Library’s code if they want to.

-All the publications in the Universal Library must be machine readable and indexable: users will need powerful algorithms to search through the immense collection of the Universal Library. Perhaps some users or companies will want to improve the search tool and build their own, or even create an AI that could look through the sum of human knowledge to find information. They should be able to do so thanks to open APIs and the entire content of every publication being machine readable. To quote Vannevar Bush on the need for good search tools: “The difficulty seems to be, not so much that we publish unduly in view of the extent and variety of present day interests, but rather that publication has been extended far beyond our present ability to make real use of the record.
The summation of human experience is being expanded at a prodigious rate, and the means we use for threading through the consequent maze to the momentarily important item is the same as was used in the days of square-rigged ships.”

-No limitation on data mining, of course. I want ContentMine to be able to mine all the literature! Note that publishers are actively trying to restrict data mining. They can try, but the Universal Library won’t let them.

-Users should be able to download any publication they want.

-The Universal Library should be protected from Law Enforcement and rogue governments, corporations and individuals. Perhaps the Universal Library should be hosted on the Deep Web, and thus only be accessible via Tor? (If it is compatible with the openness of the project: can the Universal Library still be machine readable if it is hosted on the Deep Web?) Servers should be backed-up in different places, as described earlier, too, so that copies exist even if the website is taken down.
The World Brain described by H. G. Wells in the eponymous novel was supposed to be backed-up too: “In these days of destruction, violence and general insecurity, it is comforting to think that the brain of mankind, the race brain, can exist in numerous replicas throughout the world.”
Finally the Universal Library should probably be open source so that people can improve the code.

-Users should be protected, too. Encryption must be used so that it’s difficult to trace what users do and/or download on the Universal Library. Using the Deep Web would be a plus here too, since it would be very hard for Law Enforcement to trace users’ IP addresses.
No matter what technologies are used, the Universal Library must be super secure for its users, so that knowledge is accessible even in countries where the internet is censored.
To quote Timothy C. May in the Crypto-Anarchist Manifesto: “And just as a seemingly minor invention like barbed wire made possible the fencing off of vast ranches and farms, thus altering forever the concepts of land property rights in the frontier West, so too will the seemingly minor discovery out of an arcane branch of mathematics come to be the wire clippers which dismantle the barbed wire around intellectual property.”

These are the basic specs of a modern Universal Library.

What would its impact be? For society at large, according to technologists like Kevin Kelly, it would be quite huge: “If you have access to anything that’s been written, not just theoretical access, but like, instant access, next to your brain, that changes your idea of who you are” Kelly said in the documentary Google and the World Brain, adding “It’s all human knowledge… woven into a single entity that’s accessible by anybody, anywhere in the world, anytime. And that “all knowledge” is transformative, it just really kicks up the civilization and our society into another level.”
For science, it would mean a tremendous acceleration of research, especially for scientists in the developing world and citizen scientists, who usually have very little access to scientific literature. By making knowledge more accessible, new discoveries are made faster. It’s a correlation the nineteenth-century scientist Hermann von Helmholtz noticed, remarking the link between intellectual progress and the availability of “appliances” (catalogues, lexicons, etc) that made knowledge “immediately accessible”. Though catalogues were quite primitive, the ultimate “appliance” being the Universal Library, the improved accessibility made possible by such tools created noticeable progress. So we shouldn’t underestimate the impact a Universal Library could have on scientific research.
Furthermore, little known publications would be much more visible, since they would be in the same database as the famous and big ones. This is crucial so that scientists don’t waste their time doing things that have already been done, and can communicate their discoveries easily. An old example of a discovery being delayed because of a lack of visibility, but a telling one: Gregor Mendel’s work on heredity took more than thirty years to be noticed by other researchers who built upon it to ultimately create the whole new field of genetics, just because it was published in the proceedings of a local natural history society, and thus wasn’t visible to a lot of scientists…

When will we see a Universal Library? Who will create it?
We can’t trust publishers, which have their shareholders’ interests in mind, not their customers’.
We can’t trust governments, which are corrupt. Banks, the military-industrial complex, and even publishers have bought them. In Western countries, anti-science is rampant inside governments, which are very unlikely to start a project like the Universal Library that would benefit all humankind. Even if they did, it would be plagued by bureaucracy ( anyone?). Governments would try to control who can access knowledge, just like they’ve always done. If this is subtle in the West today, keep in mind that black people in the US at the beginning of the twentieth-century couldn’t access public libraries! In the developing world, sectarianism is ubiquitous and corruption is much worse than in the West. There isn’t one government on Earth capable of building the modern Universal Library.
Independent individuals, so called “pirates”, will create the Universal Library.

The technology is here. We now need bold and talented people to step in and create the Universal Library. People who aren’t afraid of corrupt laws and bureaucrats, who are willing to take risks. I know there are some out there.