I recently wrote a tool called PipeController to experiment with pipe-like programs in Python. It does not work the same as UNIX pipes, which do IPC between programs/processes. Rather, it enables a sort of pipelined communication between multiple functions in a single Python program/process. A blog post about it (with an example of how it can be used to run a "pipe" incrementally), and a link to download PipeController v0.2, is here:
http://jugad2.blogspot.in/2012/09/using-pipecontroller-to-run-pipe.html
Running a pipe incrementally has two potential uses: 1) to debug a pipe, by generating the intermediate outputs created by adding a component at a time to the pipe, in a loop, and 2) saving the intermediate outputs, which may be of use in their own right, apart from the final output of the entire pipeline.
The blog post has a description of a test program that uses PipeController to run a pipe incrementally, along with sample input and outputs from the run.
- Vasudev Ram
Dancing Bison EnterprisesMy blog on software innovation: jugad2.blogspot.comtwitter.com/vasudevram