{"title":"PyVideo.org - SharedMemory","link":[{"@attributes":{"href":"https:\/\/pyvideo.org\/","rel":"alternate"}},{"@attributes":{"href":"https:\/\/pyvideo.org\/feeds\/tag_sharedmemory.atom.xml","rel":"self"}}],"id":"https:\/\/pyvideo.org\/","updated":"2019-05-05T00:00:00+00:00","subtitle":{},"entry":{"title":"Sharing is Caring! - how to free the CPU from message passing hell - shared memory saved the day","link":{"@attributes":{"href":"https:\/\/pyvideo.org\/pycon-italia-2019\/sharing-is-caring-how-to-free-the-cpu-from-message-passing-hell-shared-memory-saved-the-day.html","rel":"alternate"}},"published":"2019-05-05T00:00:00+00:00","updated":"2019-05-05T00:00:00+00:00","author":{"name":"Andrei Neagu"},"id":"tag:pyvideo.org,2019-05-05:\/pycon-italia-2019\/sharing-is-caring-how-to-free-the-cpu-from-message-passing-hell-shared-memory-saved-the-day.html","summary":"<h3>Description<\/h3><p>When dealing with a real time application in which you are required to\nprocess a lot of data from multiple sources in parallel, system\nresources disappear quickly. Add some CPU intensive processing and you\nare set to fail.<\/p>\n<p>This talk will illustrate a solution to solve a CPU bound \u2026<\/p>","content":"<h3>Description<\/h3><p>When dealing with a real time application in which you are required to\nprocess a lot of data from multiple sources in parallel, system\nresources disappear quickly. Add some CPU intensive processing and you\nare set to fail.<\/p>\n<p>This talk will illustrate a solution to solve a CPU bound problem with a\ndata stream of tens of megabytes. I will talk about how easy it is to\nfail and how to obtain a working solution.<\/p>\n<p>The following arguments will be discussed:<\/p>\n<ul class=\"simple\">\n<li>threading and its limitations<\/li>\n<li>multiprocessing and its limitations<\/li>\n<li>serialization<\/li>\n<li>shared memory<\/li>\n<li>a solution: multiprocessing + shared memory<\/li>\n<\/ul>\n<p>Code will be provided and shown during the talk.<\/p>\n<p><strong>Feedback form:<\/strong> <a class=\"reference external\" href=\"https:\/\/python.it\/feedback-1656\">https:\/\/python.it\/feedback-1656<\/a><\/p>\n<p>in __on <strong>Sunday 5 May<\/strong> at 11:45 <a class=\"reference external\" href=\"\/en\/sprints\/schedule\/pycon10\/\">**See\nschedule**<\/a><\/p>\n","category":[{"@attributes":{"term":"PyCon Italia 2019"}},{"@attributes":{"term":"threading"}},{"@attributes":{"term":"SharedMemory"}},{"@attributes":{"term":"#Python"}},{"@attributes":{"term":"python3"}},{"@attributes":{"term":"multiprocessing"}}]}}