Thanks to everyone for their helpful (and thankfully, mostly positive) feedback on the new Zotero-IA alliance. I wanted to try to clear up a couple of things that the press coverage and my own writing failed to communicate. (Note to self: finally get around to going to one of those media training courses so I can learn how to communicate all of the elements of a complex project well in three minutes, rather than lapsing into my natural academic long-windedness.)

1. Zotero + IA is not simply the Zotero Commons

Again, this is probably my fault for not communicating the breadth of the project better. The press has focused on items #1 and 2 in my original post—they are the easiest to explain—but while the project does indeed try to aggregate scholarly resources, it is also trying to solve another major problem with contemporary scholarship: scholars are increasingly using and citing web resources but have no easy way to point to stable URLs and cached web pages. In particular, I encourage everyone to read item #3 in my original post again, since I consider it extremely important to the project.

Items #4 and 5 also note that we are going to leverage IA for better collaboration, discovery, and recommendation systems. So yes, the Commons, but much more too.

2. Zotero + IA is not intended to put institutional repositories out of business, nor are they excluded from participation

There has been some hand-wringing in the library blogosphere this week (see, e.g., Library 2.0) that this project makes an end-run around institutional repositories. These worries were probably exacerbated by the initial press coverage that spoke of “bypassing” the libraries. However, I want to emphasize that this project does not make IA the exclusive back end for contributions. Indeed, I am aware of several libraries that are already experimenting with using Zotero as an input device for institutional repositories. There is already an API for the Zotero client that libraries can extract data and files from, and the server will have an even more powerful API so that libraries can (with their users’ permission, of course) save materials into an archive of their own.

I’m pleased to announce a major alliance between the Zotero project at the Center for History and New Media and the Internet Archive. It’s really a match made in heaven—a project to provide free and open source software and services for scholars joining together with the leading open library. The vision and support of the Andrew W. Mellon Foundation has made this possible, as they have made possible the major expansion of the Zotero project over the last year.

You will hear much more about this alliance in the coming months on this blog, but I wanted to outline five key elements of the project.

1. Exposing and Sharing the “Hidden Archive”

The Zotero-IA alliance will create a “Zotero Commons” into which scholarly materials can be added simply via the Zotero client. Almost every scholar and researcher has documents that they have scanned (some of which are in the public domain), finding aids they have created, or bibliographies on topics of interest. Currently there is no easy way to share these; giving them a central home at the Internet Archive will archive them permanently (before they are lost on personal hard drives) and make them broadly available to others.

We understand that not everyone will be willing to share everything (some may not be willing to share anything, even though almost every university commencement reminds graduates that they are joining a “community of scholars”), but we believe that the Commons will provide a good place for shareable materials to reside. The architectural historian with hundreds of photographs of buildings, the researcher who has scanned in old newspapers, and scholars who wish to publish materials in an open access environment will find this a helpful addition to Zotero and the Internet Archive. Some researchers may of course deposit materials only after finishing, say, a book project; what I have called “secondary scholarly materials” (e.g., bibliographies) will perhaps be more readily shared.

But we hope the second part of the project will further entice scholars to contribute important research materials to the Commons.

2. Searching the Personal Library

Most scholars have not yet figured out how to take full advantage of the digitized riches suddenly available on their computers. Indeed, the abundance of digital documents has actually exacerbated the problems of some researchers, who now find themselves overwhelmed by the sheer quantity of available material. Moreover, the major advantage of digital research—the ability to scan large masses of text quickly—is often unavailable to scholars who have done their own scanning or copying of texts.

A critical second part to this alliance of IA and Zotero is to bring robust and seamless Optical Character Recognition (OCR) to the vast majority of scholars who lack the means or do not know how to convert their scans into searchable text. In addition, this process will let others search through such newly digitized texts. After a submission to the Commons, the Internet Archive will subsequently return an OCRed version of each donated document to enable searchability. This text will be incorporated into the donor’s local index (on the Zotero client) and thus made searchable in Zotero’s powerful quick search and advanced search panes. In short, this process will provide a tremendous incentive for scholars to donate to the Commons, since it will help them with their own research.

3. Enabling Networked References and Annotations

One of the pillars of scholarship is the ability for distributed scholars to be sure they are referencing the same text or evidence. As noted in #1, one of the great advantages of the Zotero Commons at IA will be the transport of scholarly materials currently residing on personal hard drives to a public space with stable, rather than local, addresses. These addresses will become critical as scholars begin to use, refer to, and cite items in the Commons.

Yet the IA/Zotero partnership has another benefit: as scholars begin to use not only traditional primary sources that have been digitized but also “born digital” materials on the web (blogs, online essays, documents transcribed into HTML), the possibility arises for Zotero users to leverage the resources of IA to ensure a more reliable form of scholarly communication. One of the Internet Archive’s great strengths is that it has not only archived the web but also given each page a permanent URI that includes a time and date stamp in addition to the URL.

Currently when a scholar using Zotero wishes to save a web page for their research they simply store a local copy. For some, perhaps many, purposes this is fine. But for web documents that a scholar believes will be important to share, cite, or collaboratively annotate (e.g., among a group of coauthors of an article or book) we will provide a second option in the Zotero web save function to grab a permanent copy and URI from IA’s web archive. A scholar who shares this item in their library can then be sure that all others who choose to use it will be referring to the exact same document.

Moreover, unlike most research software the sophisticated annotation tools built into Zotero—the ability to highlight passages, add virtual Post-It notes, as well as regular notes on the overall document—maintain these annotations separately from the underlying document. This presents the exciting possibility for collaborative scholarly annotation of web pages.

4. Simplifying Collaborative Sharing

Groups of scholars also have the need to create more private “commons,” e.g., for documents that they would like to share in a limited way. In addition to the fully open Zotero Commons we will establish a mechanism for such restricted sharing. Via the Zotero Server, a user will be able to create a special collection with a distinct icon that shows up in the client interface (left column) for every member of the group.

Files added to these collections will be stored on the Internet Archive but will have restricted access. We believe that having these files reside on the IA server will encourage the donation of documents at the end of a collaborative project. The administrator of a shared collection will be able to move its contents into the fully open Zotero Commons via a single click in the administrative interface on the Zotero Server.

5. Facilitating Scholarly Discovery

The multiple libraries of content created by Zotero users and the multi-petabyte digital collections of the Internet Archive are resources that can potentially be of great use to the scholarly community. We believe that neither has experienced the level of exploration and usage we believe is possible through further development and collaboration.

The combined digital collections present opportunities for scholars to find primary research materials, to discover one another’s work, to identify materials that are already available in digital form and therefore do not need to be located and scanned, to find other scholars with similar interests and to share their own insights broadly. We plan to leverage the combined strengths of the Zotero project and the Internet Archive to work on better discovery tools.

It’s been a very busy summer at the Center for History and New Media, and especially at the Zotero project. We had our own “Summer of Code,” our ranks swelling with fantastic interns and our code repository and site expanding from their efforts and the hard work of our core staff. In case you missed it, a major upgrade was released last week with many new features and improvements and support for countless new sites. (I’ll blog about several of the new features in the coming weeks, since they lay the foundation for new kinds of digital research.)

We have also been working on several major partnerships, one of which will launch tomorrow, August 22, 2007, when the Mozilla Corporation releases Firefox Campus Edition, which will ship with Zotero preinstalled.

It’s really exciting news for us, and should greatly expand the already large Zotero community. Firefox Campus Edition will be featured on the Mozilla home page and will be marketed to colleges and universities. It will be available for download at www.firefox.com/backtoschool when it launches.

But we’re just getting started. Watch the Zotero blog and this space for more major news and partnerships in the coming weeks and months.

A great example of what I’ve been calling the “fluidity of bibliography.” WorldCat adds a feature that allows registered users to save and share lists of items they find in the WorldCat catalog. We tweak Zotero to work with it. Et voila–easy to find, save, share, grab, and re-share scholarly records.

Under the assumption that many readers of this blog don’t receive the American Historical Association’s magazine Perspectives, you might be interested in this article I wrote for the May 2007 issue. In the piece I discuss the Zotero project’s connection to several recent trends in computing, and think ahead to what the Zotero server might mean for academic fields like history.

You know a software project has reached critical mass when people start getting license plates with the project’s name on it. (Thanks to Sharon for the pic and to Roy for the plate!)

In my prior post on this topic, I mentioned the (paid) positions now available at the Center for History and New Media to work on and promote Zotero. (By the way, there’s still time to contact us if you’re interested; we just started reviewing applications, but hurry.) But Zotero is moving ahead on so many fronts that its success depends not only on those working on it full time, but also those who appreciate the software and want to help out in other ways. Here are some (unpaid, but feel-good) ways you can get involved.

If you are a librarian, instructional technologist, or anyone else on a campus or at an institution that uses citation software like EndNote or RefWorks, please consider becoming an informal campus representative for Zotero. As part of our effort to provide a free competitor to these other software packages, we need to spread the word, have people give short introductions to Zotero, and generally serve as local “evangelists.” Already, two dozen librarians who have tried Zotero and think it could be a great solution for students, staff, and faculty on their campuses have volunteered to help out in this role. If you’re interested in joining them, please contact campus-reps@zotero.org.

We are currently in the process of writing up instructions (and possibly creating some additional software) to make creating Zotero translators and citation style formatters easier. Translators are small bits of code that enable Zotero to recognize citation information on a web page; we have translators for specific sites (like Amazon.com) as well as broader ones that recognize certain common standards (like MARC records or embedded microformats). Style formatters take items in your Zotero library and reformat them into specific disciplinary or journal standards (e.g., APA, MLA, etc.). Right now creating translators takes a fair amount of technical knowledge (using things like XPath and JavaScript), so if you’re feeling plucky and have some software skills, email translators@zotero.org to get started on a translator for a specific collection or resource (or you can wait until we have better tools for creating translators). If you have some familiarity with XML and citation formatting, please contact styles@zotero.org if you’re interested in contributing a style formatter. We figure that if EndNote can get their users to contribute hundreds of style formatters for free, we should be able to do the same for translators and styles in the coming year.

One of our slogans for Zotero is “Citation management is only the beginning.” That will become increasingly obvious over the coming months as third-party developers (and the Zotero team) begin writing what we’re calling utilities, or little widgets that use Zotero’s location in the web browser to send and receive information across the web. Want to pull out all of the place names in a document and map them on Google Maps? Want to send del.icio.us a notice every time you tag something in Zotero? Want to send text from a Zotero item to an online translation service? All of this functionality will be relatively trivial in the near future. If you’re familiar with some of the browser technologies we use and that are common with Web 2.0 mashups and APIs and would like to write a Zotero utility, please contact utilities@zotero.org.

More generally, if you are a software developer and either would like to help with development or would like to receive news about the technical side of the Zotero project, please contact dev@zotero.org.

With Firefox 2.0 apparently going out of beta into full release next Thursday (October 26, 2006), it’s a great time to start talking up the powerful combination of Firefox 2.0 and Zotero (thanks, Lifehacker and the Examiner!).

For those who haven’t heard yet (it’s amazing how quickly the word spreads through the blogosphere and beyond): On October 5, 2006, at 10:47 p.m. ET, the public beta of Zotero went live on our spiffy new site. In addition to releasing the software to all comers, we’ve also expanded the documentation and set up areas of the site for Zotero users and those who want to build upon the software. If you have a question or want to discuss Zotero, we have some forums too. A few other release notes:

Remember that you’ll need Firefox 2.0 to run Zotero. Fortunately, Mozilla has just posted release candidate 2 of Firefox 2.0, which means that the final version is imminent and there’s virtually no reason not to upgrade. (If you have other Firefox extensions that don’t work with Firefox 2.0, the creators of those extensions had better get to work.)

Already, coverage of the launch has been fairly extensive, with some early reviews going up on blogs. Check our our home page for a live (and unfiltered) feed of what people are saying.

If you want some behind the scenes discussion about Zotero, check out Dan Chudnov’s podcast interview of me, Josh Greenberg, and Dan Stillman. The podcast has several exclusives, including the other names Zotero could have had (and why we went with an Albanian word).

As a beta release, Zotero still has a few rough edges, and undoubtedly it won’t please everyone on every matter. But we think it’s pretty darn good for a 1.0 beta and the basis for even better releases and features in the near future. And more important, as our unofficial motto from Voltaire at the Center for History and New Media asserts, “The perfect is the enemy of the good.” Had we gone for perfection, no one would be using the software today (or even next year). Zotero is actually shipping, and it’s free. So give it a try and tell your friends.

More here soon.

We’re ramping up here at Zotero headquarters for the big release of the public beta (it should be out next week). But we’re already thinking ahead to great new features—including nifty ways to share and collaborate, as I mentioned in my last post on Zotero—and to building not only a large and active user community, but also a community to help disseminate, support, and further develop this free and open software. In short, we need your help! In this post I’ll let you know about the official George Mason University announcements for full-time positions at CHNM (sorry for the officialese and also for the repetitiveness; it’s necessary to post these as they are recorded with GMU Human Resources). In the next post, I’ll let you know about other opportunities to help out.

Senior Programmer: The Center for History & New Media (http://chnm.gmu.edu) at George Mason University is seeking a programmer to work primarily on Zotero (http://www.zotero.org), an open source bibliographic management and note-taking tool for the Firefox web browser. Applicants should have an advanced knowledge of JavaScript, XUL, XML, CSS, and other technologies critical for Firefox development, such as XPCOM. Applicants should also have a working knowledge of PHP, Java, and MySQL, and have solid command-line Linux skills. Ability to work in a team is very important. This is a grant-funded, two-year position at the Center for History and New Media (http://chnm.gmu.edu), which is known for innovative work in digital media. Located in Fairfax, Virginia, CHNM is 15 miles from Washington, DC, and accessible by public transportation. Please send a cover letter, resume, and three references to chnm@gmu.edu with subject line “senior programmer.” Applications without a cover letter and resume will not be considered. The cover letter should include salary requirements and a description of relevant programming projects and experience. We will begin considering applications on 10/15/2006 and continue until the position is filled.

Technology Outreach Coordinator: The Center for History & New Media at George Mason University is seeking a technology outreach coordinator for Zotero (http://www.zotero.org), an open source bibliographic management and note-taking tool for the Firefox web browser. The technology outreach coordinator will be responsible for building alliances with scholarly organizations and libraries, encouraging scholars to try Zotero, developing and maintaining user documentation, and building awareness of this next-generation research tool. We are looking for an energetic, well-organized individual with excellent written and oral communication skills. Applicants should have at least some graduate training in library science or one of the humanities or social science disciplines as well as familiarity with relevant technologies (e.g., XML, RDF, metadata standards, and Firefox extensions) and scholarly research practices. This is a grant-funded, two-year position at the Center for History and New Media (http://chnm.gmu.edu) at George Mason University, which is known for innovative work in digital media. Located in Fairfax, Virginia, CHNM is 15 miles from Washington, DC, and accessible by public transportation. Please send letter of application, CV, or resume, and three references to chnm@gmu.edu with the subject line “Technology Outreach Coordinator.” We will begin considering applications October 15, 2006, and continue until the position is filled.

Web Designer: The Center for History & New Media at George Mason University is seeking a web designer and developer. We require an energetic and well-organized individual to work on a variety of innovative, web-based history projects. This position is particularly appropriate for someone with a combined interest in technology and history. The successful applicant will be able to create mockups and wireframes for historical, cultural, and educational websites and bring those ideas to fruition using the latest and highest web development standards. Fluency with current web design technologies (including ability to hand code HTML, CSS, and Javascript) and familiarity with web accessibility and web usability standards are essential. Some familiarity with web-database technologies (MySQL, PHP), contemporary trends in web development (e.g., AJAX, DHTML and DOM Scripting, Rails) and multimedia and graphic design applications (Flash, including ActionScript, Final Cut Pro, Photoshop, Illustrator) is a plus, as is prior work in history or the humanities. This is a grant-funded two-year position at the Center for History and New Media (http://chnm.gmu.edu), which is known for innovative work in digital media. Located in Fairfax, Virginia, CHNM is 15 miles from Washington, DC, and accessible by public transportation.Please send a resume, three references, links to prior web/multimedia work, and a cover letter describing technology background and any interest in history to chnm@gmu.edu with subject line “Web Designer.” Salary: $32-40K plus excellent benefits. We will begin considering applications on 10/15/2006 and continue until the position is filled.

About CHNM: Since 1994, the Center for History and New Media at George Mason University has used digital media and computer technology to change the ways that people—scholars, students, and the general public—learn about and use the past. We do that by bringing together the most exciting and innovative digital media with the latest and best historical scholarship. We believe that serious scholarship and cutting edge multimedia can be combined to promote an inclusive and democratic understanding of the past as well as a broad historical literacy that fosters deep understanding of the most complex issues about the past and present. CHNM’s work has been internationally recognized for cutting-edge work in history and new media. Located in Fairfax, Virginia, CHNM is 15 miles from Washington, DC, and is accessible by public transportation.

Please also see the second post in this series for other exciting opportunities to help out and extend Zotero.

So much for a modest, stealthy launch of Zotero. I promised a couple of weeks ago that I would return to my blog soon with a few updates about user feedback, some hints about new features, and perhaps some additional news items. With a modest private beta test and a few pages explaining the software on our new site, I assumed that Zotero would quietly and slowly enter into public consciousness. Little did I know that within two weeks I would get over 400 emails asking to join the beta test, help develop and extend Zotero, make it work better with resources on the web, and evangelize it on campuses and in offices around the globe. (Sorry to those I haven’t responded to yet; I’m still working on my email backlog.) Better yet, we received some fantastic news about support for the project, which is where I’ll begin this update.

The big news is that the Center for History and New Media has received an incredibly generous grant from the Andrew W. Mellon Foundation to help build major new features into the 2.0 release of Zotero (coming in 2007). Included in this substantial upgrade are great capabilities that beta testers are already clamoring for (as I’ll describe below). I’m deeply appreciative to the Mellon Foundation and especially Ira Fuchs and Chris Mackie for their support of the project, and we’re delighted to join the stable of other Mellon-funded, open-source projects that are trying to revolutionize higher education and the scholarly enterprise through the use of innovative information technology. We have a very ambitious set of goals we would like to accomplish in the next two years under Mellon funding, and we’re really excited to get started and push these advances out to an eager audience.

My thanks also to the beta testers who have reported bugs and sent in suggestions. (For a few early reviews and thoughts about Zotero, see posts on the blogs of Bill Turkel, Bruce D’Arcus (1, 2), Adrian Cooke, Jeanne Kramer-Smyth, and Mark Phillipson.) We’re planning on rolling all of the bug fixes and a few of the suggestions that we’ve already implemented into the public beta that will be released shortly. The most requested new features were auto-completion/suggestions for tags, better support for non-Western and institutional authors, full-text searches of articles that are saved into one’s Zotero collection, more import/export options, support for other online collections and resources, and the detection of duplicate records. The developers are working feverishly on all of these fronts, and I think the Beta 2 release (our public beta) will be considerably better because of all of this helpful feedback.

I have intentionally left out perhaps the most wanted feature: tools for collaboration. Some of those who have started to hack the software have noticed what we at the Center for History and New Media have been thinking about from the start—that it seems very easy to add ways to send and receive information to and from Zotero (it does reside in the web browser, after all). What if you could share a folder of references and notes with a colleague across the country? What if you could receive a feed of new resources in your area of interest? What if you could synchronize your Zotero library with a server and access it from anywhere? What if you could send your personal collection to other web services, e.g., a mapping service or text analyzer or translation engine?

I’m glad so many of us are thinking alike. Those are the issues we’ve just started to work on, thanks to the Mellon Foundation. Stay tuned for the Zotero server and additional exciting extensions to the Zotero platform.

And despite my email backlog, please do contact me if you would like to join the Zotero movement.