Getting a real-time look at open source

Posted 22 Jan 2004 at 05:34 UTC by micahjd Share This

Recently I've been working on a project that might be of interest to other Advogato users: CIA, a system for tracking commit messages (and eventually other things) from any open source project. When new code is committed, the news instantly shows up on a web site, an RSS feed, and an IRC channel.

Unlike other similar projects that focus on bringing one project's commits to only its developers, CIA lets anyone see what development is happening right now, regardless of where or what for.

This project actually started more than six months ago- near the end of May when I was still an active developer on the PicoGUI project. I put together a simple bot for monitoring the project's commits. This quickly grew into a somewhat hackish but popular system for tracking multiple projects.

Recently I've been working on a complete rewrite of the original code. This time it does more than IRC, and is much more maintainable. Each project and each author now has a separate page showing recent commits and some stats. The code is easy to extend to other types of messages: bug reports, automated build results, and such.

More information and the actual data is available at the project's web site:

http://cia.navi.cx


CVSToys, posted 22 Jan 2004 at 05:55 UTC by etrepum » (Journeyer)

CVSToys does this sort of stuff. I think by default it connects to IRC, perhaps other places. I'm not sure, I've only seen the messages it generates on #twisted and #quotient on freenode. [note that twistedmatrix.com is down at the moment, will be resolved shortly]

Additionally, buildbot integrates with CVSToys to give you multi-machine multi-platform compiles and test suites, with results aggregated in real-time on a web page (or GTK client, I think).

Re: CVSToys, posted 22 Jan 2004 at 06:02 UTC by micahjd » (Master)

I first saw CVSToys some time shortly after I'd written the first CIA bot. Quite a lot nicer than the original CIA, but tied a little too closely with CVS and Twisted for me. The new CIA is in fact written with Twisted, but using a simple XML message format rather than Perspective Broker makes it easy to write clients in Python, Perl, Bash, or pretty much anything.

Interesting that you mention buildbot too. The PLD linux folks had apparently been using the old CIA for automated build notifications for a while. The new CIA now has a schema for XML build system update messages, though the server doesn't have any formatters for those yet.

Re: CVSToys, posted 22 Jan 2004 at 06:32 UTC by etrepum » (Journeyer)

Well, I can imagine that a PB-XML gateway would be easier than rewriting CVSToys ;) You are probably right about it being too closely tied to CVS, though, because I haven't seen one for subversion yet.

Buildbot uses CVSToys as one of many possible sources of build requests, so you might want to look into working with warner and adding CIA support to it, because that would be cool.

RSS feeds, posted 23 Jan 2004 at 19:46 UTC by lkcl » (Master)

viewcvs now supports cvs _and_ subversion (no name change in order to not confuse the innocent).

anyone want to add an RSS feed to it?

CIA is way cool, posted 12 Feb 2004 at 14:31 UTC by jamey » (Master)

We've been using CIA on #handhelds.org for a month or two and it is way cool. Seeing the commit messages lets people know what development activity is going on and leads to quicker cross-pollination between the handhelds.org projects.

Because the message format is so simple, we have also hooked up package upload notifications to CIA. We have a separate script that generates an RSS feed for package uploads that is displayed on http://www.handhelds.org/ -- it might be nice if CIA had an RSS generator.

CIA is way cool, posted 12 Feb 2004 at 14:32 UTC by jamey » (Master)

We've been using CIA on #handhelds.org for a month or two and it is way cool. Seeing the commit messages lets people know what development activity is going on and leads to quicker cross-pollination between the handhelds.org projects.

Because the message format is so simple, we have also hooked up package upload notifications to CIA. We have a separate script that generates an RSS feed for package uploads that is displayed on http://www.handhelds.org/ -- it might be nice if CIA had an RSS generator.

CIA is way cool, posted 12 Feb 2004 at 21:08 UTC by jamey » (Master)

We've been using CIA on #handhelds.org for a month or two and it is way cool. Seeing the commit messages lets people know what development activity is going on and leads to quicker cross-pollination between the handhelds.org projects.

Because the message format is so simple, we have also hooked up package upload notifications to CIA. We have a separate script that generates an RSS feed for package uploads that is displayed on http://www.handhelds.org/ -- it might be nice if CIA had an RSS generator.

New Advogato Features

New HTML Parser: The long-awaited libxml2 based HTML parser code is live. It needs further work but already handles most markup better than the original parser.

Keep up with the latest Advogato features by reading the Advogato status blog.

If you're a C programmer with some spare time, take a look at the mod_virgule project page and help us with one of the tasks on the ToDo list!

X
Share this page