The open source CE edition of pipes.digital
pipes.digital is a spiritual successor to Yahoo Pipes, a graphical interface to get data from the web and to manipulate it by connecting block. It's heavily focused on the concept of feeds, that data flows item by item from block to block, with RSS as the default and internally used format. The CE edition is the FOSS core of pipes.digital, minus things like a pricing page and user plans.
To get an impression of how pipes works without installing anything, try pipes.digital first.
Clone this repository. You need to install Ruby and the bundler gem:
gem install bundler
Then cd into the cloned repository and download the required gems with bundler:
bundle install
Some gems won't install without some additional requirements, like sqlite3.
Also install memcached, it is used for caching and required. For development you can run it in a terminal:
memcached
Now install the npm managed CSS and JS dependencies with:
cd public/
npm install --omit=dev
When everything is installed and memcached runs you can start the server:
PIPES_URL_SECRET="CHANGE_THIS" bundle exec puma -e development
Note the PIPES_URL_SECRET, given to the program as an environment variable. Choose one string for that
and use it permanently for pipes to keep their url.
Set these environment variables to activate the integration blocks that provide easier access to data from other sites (e.g. mixcloud). Enter an URL to an instance of the used services that you ideally host yourself:
PIPES_RSSBOX # https://github.com/stefansundin/rssbox, e.g. https://rssbox.example.com/
PIPES_RSSBRIDGE # https://github.com/RSS-Bridge/rss-bridge, e.g. https://example.com/bridge01
Pipes CE uses portier to provide an easy passwordless login. After the installation you can immediately login with every email address you control.
This blog article explains the architecture and most of the software used. It is a good starting point if you want to make changes. Also useful is the newer DEVELOPMENT.md file stored in this repository, with a different approach of explaining the architecture.
The code is dual licensed: AGPL, but with the exception of not having to share code run on pipes.digital, the founding project (this so far only touches stuff like the pricing page, as explained above).
Feature and Pull Requests are welcome. If in doubt open an issue before investing the work to discuss deeper changes, though those are also welcome.
You can also join the gitter channel.
The icons under public/icons are the Feather icon set v4.29.0 by @colebemis.