3 Apr 2003 sjanes71   » (Journeyer)

pydbbench     Putzed a bit last night getting pydbbench to generate GNU Plots of the execution data. It made pretty pictures but didn't really progress the framework of getting a Python script to automatically run and summarize benchmarks. Tonight I had a small fight with DB 2.0 API until I figured out that the pyPgSQL has a more advanced "connect_string" feature (send a string or a dict of parameters) than the MySQLdb library has (only a string is allowed.)

The only test written is a connect-disconnect test and the harness makes runs roughly:

each benchmark to run 120 seconds
for each driver: (PostgreSQL, MySQL)
  for each benchmark: (dbconnectdisconnect)
    run the setup
    for each concurrency: (1,25,100,250,500)
      run that benchmark
      summarize that benchmark
    run the teardown

When it starts hammering 500 sessions I think either the 2.4.20 Linux scheduler or Python threading starts to choke. I don't have enough hardware to run the benchmarker against a different machine where I would expect some different numbers. Now I'm getting to a point where it's time to write some more interesting tests. The framework also tracks successful iterations which I just tested by setting the max-connections for MySQL down fairly low. I'm going to stop hacking on it tonight and go back and do some reading.

Latest blog entries     Older blog entries

New Advogato Features

New HTML Parser: The long-awaited libxml2 based HTML parser code is live. It needs further work but already handles most markup better than the original parser.

Keep up with the latest Advogato features by reading the Advogato status blog.

If you're a C programmer with some spare time, take a look at the mod_virgule project page and help us with one of the tasks on the ToDo list!