warning: Creating default object from empty value in /var/www/drupal/modules/taxonomy/taxonomy.pages.inc on line 33.

freshmeat

Freecode is no longer updating

Freecode (formerly Freshmeat), the directory of Free and Open Source Software Projects, is no longer accepting new submissions. As of June 18, their site has this message on top:

The last full scrape of the Freecode RDF files took place in March. The data for the March 2014 Freecode collection is available for download from the FLOSSmole FC data site (or in the MySQL database).

RIP Freecode, nee Freshmeat.

Growth of Projects in Each Repository (June 2014)

Description:

This chart shows the number of NEW projects added to each repository by month/year.

Visualization:

Notes: RF had ~750 projects without a project start date.

SQL Script:

SELECT MONTH( date_added ) , YEAR( date_added ) , COUNT( DISTINCT project_id )
FROM fm_projects
WHERE datasource_id = [current]
GROUP BY YEAR( date_added ) , MONTH( date_added )
ORDER BY YEAR( date_added ) , MONTH( date_added );

SELECT MONTH( date_registered ) , YEAR( date_registered ) , COUNT( DISTINCT proj_unixname )
FROM rf_projects
WHERE datasource_id = [current]
GROUP BY YEAR( date_registered ) , MONTH( date_registered )
ORDER BY YEAR( date_registered ) , MONTH( date_registered );

SELECT MONTH( registration_date ) , YEAR( registration_date ) , COUNT( DISTINCT project_name )
FROM sv_projects
WHERE datasource_id = [current]
GROUP BY YEAR( registration_date ) , MONTH( registration_date )
ORDER BY YEAR( registration_date ) , MONTH( registration_date );

Growth of use of "Free" and "Open" in Project Names (2014 data)

Description:

This chart shows the number of new projects in each repository that use the words "Free" and "Open" in project names through 2014.

Visualization:

SQL Script:

Freshmeat:

SELECT YEAR( date_added ) , COUNT( DISTINCT project_id ) AS Count
FROM fm_projects
WHERE projectname_full LIKE "%free%"
AND datasource_id = [current]
GROUP BY YEAR( date_added )
ORDER BY YEAR( date_added );

SELECT YEAR( date_added ) , COUNT( DISTINCT project_id ) AS Count
FROM fm_projects
WHERE projectname_full LIKE "%open%"
AND datasource_id = [current]
GROUP BY YEAR( date_added )
ORDER BY YEAR( date_added );

Rubyforge:

SELECT YEAR( date_registered ) , COUNT( DISTINCT proj_unixname ) AS Count
FROM rf_projects
WHERE proj_unixname LIKE "%free%"
AND datasource_id = [current]
GROUP BY YEAR( date_registered )
ORDER BY YEAR( date_registered );

SELECT YEAR( date_registered ) , COUNT( DISTINCT proj_unixname ) AS Count
FROM rf_projects
WHERE proj_unixname LIKE "%open%"
AND datasource_id = [current]
GROUP BY YEAR( date_registered )
ORDER BY YEAR( date_registered );

Savannah:

SELECT YEAR( registration_date ) , COUNT( DISTINCT project_name ) AS Count
FROM sv_projects
WHERE project_name LIKE "%free%"
AND datasource_id = [current]
GROUP BY YEAR( registration_date )
ORDER BY YEAR( registration_date );

SELECT YEAR( registration_date ) , COUNT( DISTINCT project_name ) AS Count
FROM sv_projects
WHERE project_name LIKE "%open%"
AND datasource_id = [current]
GROUP BY YEAR( registration_date )
ORDER BY YEAR( registration_date );

Freecode New Project Registrations by Month, 1998-2014

Freecode (formerly known as Freshmeat) is a directory of free and open source software. FLOSSmole has been collecting Freecode/Freshmeat data since 2004. Periodically we provide snapshots as to the growth of the various forges and directories we collect data from. Here is a chart showing the rate of new project additions to Freecode/Freshmeat from January 1998 - March 2014. This data is based on the registration date recorded for each project and collected by FLOSSmole in June 2014(datasource_id 8079).

The SQL code to gather this data from our FLOSSmole database is as follows:

SELECT CONCAT(MONTH( date_added ) , '-', YEAR( date_added )) , COUNT( DISTINCT project_id )
FROM fm_projects
WHERE datasource_id = [current datasource_id]
GROUP BY YEAR( date_added ) , MONTH( date_added )
ORDER BY YEAR( date_added ) , MONTH( date_added );

Freecode Project Registrations (1998-2014) with language tags

This chart shows the new project registrations for each year 1998-2014, and what programming language those projects were tagged with.

For example, 2003 was the highest year for new "C" projects to be registered with Freecode (then called Freshmeat).

(Couple of caveats about the data here: (1) A project could be tagged with one language when it's created, and then the tag could change later. For example a project may have been created as "C" and then later switched its tags to "Java". This chart will show whatever the most current language tag is for that project. I have not calculated the number of times this happens or if it is likely, but I suspect that it is not too common. (2) The languages in the legend are in order of the total number of times they exist as tags for any project. (3) Not every project has a language tag for itself.)

Here is the SQL code used to generate the data sets for this graph:

SELECT YEAR(p.date_added ) , COUNT( DISTINCT p.project_id )
FROM fm_projects p
INNER JOIN fm_project_tags t
ON t.project_id = p.project_id
WHERE p.datasource_id = 316
AND t.datasource_id=316
AND t.tag_name="C"
GROUP BY 1
ORDER BY 1;

Substitute your current datasource_id and any valid programming language tag. I used the following:

C
Java
C++
PHP
Perl
Python
JavaScript

These are in order of total number of times they appeared in the sitewide tag list over time.

Other top languages, in order of frequency the tag is used:

Unix Shell
XML
SQL
HTML
Ruby
Tcl

Updated Freecode Project Counts, 2005-2014

We have collected Freecode (formerly Freshmeat) data since 2005. This chart shows the number of projects listed in the Freecode directory between 2005 and 2014. Each line represents one collection. (Collections are referred to in our database by the term "datasource_id".)

Here is the code used in the FLOSSmole database to generate the data list to create this graph:

SELECT f.datasource_id, year(d.date_donated), count( f.project_id )
FROM fm_projects f
INNER JOIN datasources d
ON f.datasource_id=d.datasource_id
GROUP BY 1,2
ORDER BY 1,2

Freecode New Project Registrations (1998-2011) and language tags

This chart shows the new project registrations for each year 1998-2011, and what programming language those projects were tagged with.

For example, 2003 was the highest year for new "C" projects to be registered with Freecode (then called Freshmeat).

(Couple of caveats about the data here: (1) A project could be tagged with one language when it's created, and then the tag could change later. For example a project may have been created as "C" and then later switched its tags to "Java". This chart will show whatever the most current language tag is for that project. I have not calculated the number of times this happens or if it is likely, but I suspect that it is not too common. (2) The languages in the legend are in order of the total number of times they exist as tags for any project. (3) Not every project has a language tag for itself.)

Here is the SQL code used to generate the data sets for this graph:

SELECT YEAR(p.date_added ) , COUNT( DISTINCT p.project_id )
FROM fm_projects p
INNER JOIN fm_project_tags t
ON t.project_id = p.project_id
WHERE p.datasource_id = 316
AND t.datasource_id=316
AND t.tag_name="C"
GROUP BY 1
ORDER BY 1;

Substitute your current datasource_id and any valid programming language tag. I used the following:

C
Java
C++
PHP
Perl
Python
JavaScript

These are in order of total number of times they appeared in the sitewide tag list over time.

Other top languages, in order of frequency the tag is used:

Unix Shell
XML
SQL
HTML
Ruby
Tcl

Freecode/Freshmeat Project Counts, 2005-2012

We have collected Freecode (formerly Freshmeat) data since 2005. This chart shows the number of projects listed in the Freecode directory between 2005 and 2012. Each line represents one collection. (Collections are referred to in our database by the term "datasource_id".)

Obviously in looking at this chart, we are curious what happened between datasource_id's 160 and 173 (between March and June 2009) when the number of projects listed appears to have been pruned by about 6,000 projects. We recall that on March 14, 2009 the Freshmeat site underwent a redesign (named Freshmeat 3.0), so this might have been related.

Here is the code used in the FLOSSmole database to generate the data list to create this graph:

SELECT f.datasource_id, year(d.date_donated), count( f.project_id )
FROM fm_projects f
INNER JOIN datasources d
ON f.datasource_id=d.datasource_id
GROUP BY 1,2
ORDER BY 1,2

Freecode New Project Registrations by month, 1998-2012

Freecode (formerly known as Freshmeat) is a directory of free and open source software. FLOSSmole has been collecting Freecode/Freshmeat data since 2004. Periodically we provide snapshots as to the growth of the various forges and directories we collect data from. Here is a chart showing the rate of new project additions to Freecode/Freshmeat from January 1998 - June 2012. This data is based on the registration date recorded for each project and collected by FLOSSmole in mid-July 2012 (datasource_id 316).

The SQL code to gather this data from our FLOSSmole database is as follows:

SELECT MONTH( date_added ) , YEAR( date_added ) , COUNT( DISTINCT project_id )
FROM fm_projects
WHERE datasource_id = [current datasource_id]
GROUP BY YEAR( date_added ) , MONTH( date_added )
ORDER BY YEAR( date_added ) , MONTH( date_added );

Freshmeat becomes Freecode, and how our data is affected

Three things happened recently to affect our Freshmeat collection

1. Freshmeat announced a name change to Freecode.
2. We have an issue (issue #43) that talks about how the trove definitions for Freshmeat are out of date.
3. Freshmeat replaced trove with tagging and we missed the memo

What I've done is as follows:

For issue #1 - decided not to rename our abbreviation for Freshmeat. It will remain "FM".

For issue #2 & 3 - Added a new table to hold the tags associated with a project. It's called fm_projects_tags.

CREATE TABLE IF NOT EXISTS `fm_project_tags` (
`project_id` int(11) NOT NULL DEFAULT '0',
`datasource_id` int(11) NOT NULL DEFAULT '0',
`tag_name` varchar(50) NOT NULL DEFAULT '0',
`timestamp` datetime NOT NULL DEFAULT '0000-00-00 00:00:00',
PRIMARY KEY (`project_id`,`datasource_id`,`tag_name`),
KEY `datasource_id_index18` (`datasource_id`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1;

Added a new release file to hold the data from this table. The new file is called fmProjectTags2011-Nov.txt. Did not remove trove; we are still collecting the trove. Although there is no longer any "trove definition" list that I know of to describe each trove number, so these are not as useful as the "tags". But I'm leaving this alone in the database for historical purposes.

Here is a shot of the tags page for a sample project on Freshmeat, called amms.

Here is a shot of the way the tags look now in our release files (or database table) for that same project (#78922)

Syndicate content