Details about the repository collections
Submitted by megan on June 18, 2010 - 9:59pm
Introducing a new data source: Launchpad data. In this collection, Launchpad has about 19k projects in it and about 34k developers.
mysql> select count(*) from lp_projects where datasource_id=227;
18956
mysql> select count(distinct dev_loginname) from lp_developer_indexes where datasource_id=227;
34051
Available on our Google Code downloads page: Launchpad data
Submitted by megan on June 6, 2010 - 11:11am
Submitted by megan on May 4, 2010 - 1:01pm
May 2010 data is released for some forges.
-Freshmeat (datasource 218)
-Rubyforge (datasource 219)
-ObjectWeb (datasource 220)
-Free Software Fntn (datasource 221)
-Google Code (datasource 222) - list of projects only
Our collectors for Savannah, Sourceforge, Github, Tigris, Launchpad are all undergoing maintenance at the moment.
UPDATE May 28, 2010
-Savannah data has been released (datasource 224)
Link to download the FLOSSmole data on Google Code.
Submitted by megan on March 9, 2010 - 7:41pm
Lots of new data for you to peruse out on our FLOSSmole Data Downloads Page.
Here's what's out there, recently added:
Google Code, March 2010 (GC) - list of all GC projects donated by Audris Mockus (HUGE THANK YOU TO AUDRIS FOR THIS!!)
Freshmeat, February 2010 (FM)
Objectweb, February 2010 (OW)
Rubyforge, February 2010 (RF)
Github, February 2010 (GH)
Free Software Foundation, February 2010 (FSF)
Savannah, February 2010 (SV)
and Sourceforge from December 2009 (SF)
Submitted by megan on February 17, 2010 - 11:54am
After long delay, the December Sourceforge data has been released. You may recall that over summer 2009, SF redesigned their web site which broke many of our crawlers and all of our parsers.
We have re-written these, and with only a few exceptions, have pretty much the same data as we always had.
Here are some release notes:
Submitted by megan on December 9, 2009 - 11:49am
December data has been released for the following forges:
(datasource-abbreviation-full name)
200-fm-freshmeat
201-rf-rubyforge
202-ow-objectweb
203-fsf-free software foundation
204-sv-savannah
205-gh-github
Sourceforge is in progress... it will be datasource_id=206.
Get the data here:
http://code.google.com/p/flossmole/downloads/list
Remember that the files marked "DM" are SQL files (mysql) but the files marked .txt are flat text files (delimited)
Submitted by megan on November 19, 2009 - 9:28am
This month we have data from Freshmeat, Rubyforge, Objectweb, Savannah, Github, Free Software Foundation.
Downloads available at Google Code
Remember, the SQL is available in the datamart*.sql.bz files, the flat (delimited) data is available in the other files.
We're still working on getting our Sourceforge scraper back up and running, and we thank you for your patience.
Submitted by megan on October 11, 2009 - 9:47am
October 2009 data has been released. Here are the forges we have this month:
Freshmeat
Rubyforge
ObjectWeb
Free Software Foundation directory
Savannah (new)
GitHub (new)
FLOSSmole Downloads
Sourceforge is undergoing a re-write, still, but we will be collecting again from there soon. In the meantime, don't forget that the June 2009 data is available, and also there is the Notre Dame data if you find that helps at all.
Submitted by megan on September 2, 2009 - 8:45pm
Data has been released for FSF, FM, RF, OW. Go get it!! Have fun.
Google Code Downloads Page
That Freshmeat data looks fairly popular. Anyone want to tell us how you use this data?
Submitted by megan on August 11, 2009 - 7:48pm
Savannah data has been released for July. See what you think! (Datasource_id = 182)
Pages
