Motivation

Our kinesis_connector.py is currently used at several locations in our code, and the usage of it is in principal valid.
However, it has some problems with threads not shutting down, processes kept alive indefinitely, and a lot of unused configuration options cluttering the code.

To continue using it, we want:

• A clear shutdown of all processes and threads, with a single stop
• A reduction in created processes and threads
• Simpler code, by refactoring and removing unused configuration options

Changes

• Enable new (-ext) Resource Provider for AWS::KinesisAnalytics::Application
• Refactor kinesis connector, get rid of output file reader threads, proper shutdown, more class encapsulation, less configuration variable
• Remove "environment" logic from aws stack
• Add try/finally around docker container startup logic to prevent stuck threads waiting for a event forever.