Archive
Archive for October, 2015
Uitslagen 2015
16 October 2015
Leave a comment
| # | datum | wedstrijd | plaats | afstand | tijd |
|---|---|---|---|---|---|
| 1. | 12-apr-15 | ETU EK Powerman Holland Duathlon 2015 – Sprint | Horst | 5-20-2,5km | 1:07:37 [u]![]() ![]() ![]() |
| 2. | 29-aug-15 | Run Bike Run Borne | Borne | 6,5-30-4,8km | 1:47:22 [u]![]() ![]() ![]() |
Planning :
- 31-dec-15 – Sylvestercross, Soest
dikgedrukt is een PR
Categories: Uncategorized
Spark Streaming Backpressure – finding the optimal rate is now done automatically
6 October 2015
10 comments
One of my complaints about Spark was that it wasn’t possible to set a dynamic maximum rate. This is a problem in many jobs since the maximum throughput isn’t always linear with the output rate. Another issue is with local testing. You have to set the rate to extremely low values and experiment a lot to make a Spark job usable on a local machine.
But all these problems are in the past with the introduction of backpressure (I believe it’s spelled as back pressure, but I’ll stick to the Spark notation).

