We are looking for an open minded developer to fill out the Big Data Developer position in BITĖ Group. Key responsibilities in the position is to develop data pipelines meeting business analytics requirements. You would be responsible for extracting data from a source, making sure it is valid and consistent, then transforming it in a way that it meets the data model abstraction.
You would be developing data ingestion and processing with Python, using Apache NiFi or Apache Airflow to coordinate data from one place to another. For example one of your tasks could be moving data from unstructured Kafka message log to HDFS, making sure that data is valid and consistent.