DevOps Engineer – Airflow Apache, Python, Perl Script, Schedulers
E-mail job details to friend Print job detailsRecruiter: Construction Management Jobs
DevOps Engineer – Airflow Apache, Python, Perl Script, Schedulers
£35,000 to £35,000 per annum | London | Date posted 06 Jan 2023
DevOps Engineer – Airflow Apache, Python, Perl Script, Schedulers
£ Market Rates (Inside IR35) Umbrella
London / Remote
6 Months
My client is a major International Consultancy, who are delivering into a Tier 1 Investment Bank based in London. They urgently require an Airflow Apache Technical Specialist to work on a business-critical programme in a hands-on capacity.
Key Requirements:
• Demonstrable experience working as a DevOps Engineer in a large and complex environment
• Experience with developing guidelines for Airflow clusters and DAG's
• Proven hands-on experience with Performance tuning of the DAG and task implementation
• Comfortable developing DAG - data pipeline to on-board and change management of datasets
• Experience installing Apache Airflow, configuring, and monitoring Airflow cluster
• Understanding of airflow rest services and integration of airflow of platform eco-system
• Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Expertise in Python, ControlM, AutoSys, Crontab, Shell Script, Perl Script, Schedulers
• Knowledge of full software development life cycle (coding standards, code reviews, etc)
• Fast learner and a team player
• Knowledge of Google Cloud Platform and Google Cloud Composer
Nice to have:
• Previous Financial Services experience, understanding of up and downstream batches
• Understanding of batch scheduling
• Agile / Scrum principles
• Immediately available
• Flexible to go on site at London location
If interested, with relevant skills and experience, please send your latest CV ASAP for a discussion.
#4343989
£ Market Rates (Inside IR35) Umbrella
London / Remote
6 Months
My client is a major International Consultancy, who are delivering into a Tier 1 Investment Bank based in London. They urgently require an Airflow Apache Technical Specialist to work on a business-critical programme in a hands-on capacity.
Key Requirements:
• Demonstrable experience working as a DevOps Engineer in a large and complex environment
• Experience with developing guidelines for Airflow clusters and DAG's
• Proven hands-on experience with Performance tuning of the DAG and task implementation
• Comfortable developing DAG - data pipeline to on-board and change management of datasets
• Experience installing Apache Airflow, configuring, and monitoring Airflow cluster
• Understanding of airflow rest services and integration of airflow of platform eco-system
• Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Expertise in Python, ControlM, AutoSys, Crontab, Shell Script, Perl Script, Schedulers
• Knowledge of full software development life cycle (coding standards, code reviews, etc)
• Fast learner and a team player
• Knowledge of Google Cloud Platform and Google Cloud Composer
Nice to have:
• Previous Financial Services experience, understanding of up and downstream batches
• Understanding of batch scheduling
• Agile / Scrum principles
• Immediately available
• Flexible to go on site at London location
If interested, with relevant skills and experience, please send your latest CV ASAP for a discussion.
#4343989