query tool

version .01 of our query tool is up and running. Thanks, Dawid!

October Data, updated

The SF and Freshmeat (surprise!) data collections for October are DONE. We had a 10-machine grid working to collect this time. Very speedy! We plan to move to collections on a 60-day rotation, rather than 90-days from here on out. This will match up nicely with the 60-day sourceforge stats interval also.

Also, we have a working prototype of our live query tool -thanks Dawid!- we're just waiting for the production environment to be set up and that will be available for you all to use.

Here is the master file list on our SF project page: Master List of FLOSSmole Files, but we also have quicker links to:

Happy Birthday, FLOSSmole

Happy Birthday, FLOSSmole (nee OSSmole). It was 1 year ago today that we started FLOSSmole project on Sourceforge. What a joyous occasion.

Like any one-year-old, FLOSSmole is growing rapidly, learning new things, meeting new people, and generally being cute. (Ok, maybe spreadsheets aren't all that cute afterall.)

But like any proud mama, I am pleased with the progress of FLOSSmole, and I'd like to take all the credit, but really, we all know that with open source projects, "it takes a village". (And basically my role is just to avoid being the Village Idiot.) Thank you to a wonderful team.

July Raw Developer Data

The July raw developer data has finally been released. I had actually forgotten about it (oops). We had a problem in the way our spider collected the datasource_id=5 developers, so I had put off the release until I fixed that problem, and then I promptly forgot about the whole thing.

In any event, the files are posted, so enjoy!

These files contain (a) complete lists of developers and (b) complete lists of which developer is working on which project, and whether they are an admin on that project. If you need historical data (to judge developer movement between projects), refer to earlier file releases (i.e. April, January, November 2004, etc).

And the developer problem was fixed in the spider code, so everything should be back to normal for the October release! Thanks for your patience.

some changes in the works

Coming up:

1. we'll be doing our next SF "run" in October

2. we're making a web interface for "live" read-only queries - this will satisfy our occasional middle-of-the-night wild hypotheses... "gee, I wonder if developers who program in python also program in java or perl... and where are all these ruby hackers coming from anyway...?" You've got questions, we've got answers.

3. if you've used our data in a project, let us know! It feels good to know we've helped you out. Even better, consider letting us host your data or your results. You'll be world-famous, and get the satisfaction of "giving back" to the open source community.

July Summary Project Data

Since I've been at Oscon this week, I've been delayed in posting my summary analyses. Nevertheless, for those who are waiting, I've posted some basic summaries in the directory below

Here is a directory of excel files showing October 2004, January 2005, April 2005, and July 2005 Summary Data for projects on Sourceforge.

Remember, raw data is also available!

July Raw Project Data

Good news, moles! Some of the July project files (SF only) have been posted to the SF project page

(1) July Raw Project Info here: SourceForge.net: Project Info Filelist.

There are 2 files in here:

--ProjectList gives the project names only
--ProjectInfo gives the project unixnames, dates registered, number of developers, and the date the information was collected by FLOSSmole.

(2) July Raw Project Data here: SourceForge.net: Project Data Filelist

There are 8 files in here:
--Database Environments
--Intended Audience
--License Types
--Operating Systems
--Programming Languages
--Project Status
--Project Topic
--User Interface

Coming up soon will be Summary Project Data with beautiful charts (hopefully!), Raw Developer Data, and Summary Developer Data.


(1) You might notice we changed the name of OSSmole to FLOSSmole. This name change is to reflect the presence of free and libre projects as well. Plus, it will alleviate confusion about how to pronounce the name of the project... now it's just two normal english words: "floss" and "mole". No more spelling or guessing!

(2) This July run is taking forever! I've got all the index.html's and all the developer data, but the scrapes are taking a really long time to UPDATE and INSERT into mysql. Not sure what's going on there but I thank you for your patience. Some of them have been running for a week and I'm still only on 'y'.

(3) Finally, is anyone going to be at OSCON next week? I made a t-shirt with the mole logo on it so if you see me, you'll know :)

almost there...

I'm leaving for the beach, but as soon as we get Internet set up over there (this afternoon?), I'll pick back up. Finished 'm', 'n', and 'o' last night, so we're on "p".


OSSmole gives a huge shout-out to swik, an open wiki-like database about open source projects.

Here's the OSSmole page on swik, and hopefully it'll reflect my comments here about the July run happening at this very moment... JULY DATA should be done before I leave for the beach next week, yay. I'm on 'g' right now.
Syndicate content