Over at OUseful, there’s a post for those of you looking for a way to build pipelines. The two systems that are mentioned take their cues from Yahoo pipes, but allow for extending the set of functions to make pretty sophisticated data processing pipelines. If you’re in the market for something new … it might pay to have a look.
In doing so, I came across a couple of other visual pipeline environments that are maybe worth looking at in a little more detail.
PyF is a “[flow based] open source Python programming framework and platform dedicated to large data processing, mining, transforming, reporting and more.”
On the other hand, Orange claims to offer “[o]pen source data visualization and analysis for novice and experts. Data mining through visual programming or Python scripting. Components for machine learning. Extensions for bioinformatics and text mining. Packed with features for data analytics.”