Data Engineer - United Kingdom - remote working

£45K - £55K + bonus - Data, Reporting & Analytics
Ref: 855 Date Posted: Tuesday 22 Mar 2022
LinkedIn ShareShare

Suitable for:       Senior Data Engineer approx. 5+ years’ experience

Location:             Hybrid / Leeds / client site

Duration:             Permanent

Salary:                 £45k - £55k + bonus

Please note that unfortunately, our client is unable to offer sponsorship

Our client a leading digital transformation consultancy are looking for an experienced Data Engineer to join their team. You’ll get to join an employee-owned business that takes its people seriously and where you will be truly valued.

Experience/Attributes:

Ideally the Data Engineer will have worked in a people focussed, fast paced and dynamic organisation. You will be comfortable interacting with stakeholders at all levels.  Additionally, the Data Engineer will have;

  • A deep understanding of distributed computing principles
  • Experience of management of Hadoop cluster, including diagnosing and solving issues with cluster operations
  • Proficiency with Hadoop, MapReduce, HDFS
  • Experience with building stream-processing systems, using solutions such as Storm, Flink or Spark-Streaming
  • Good knowledge of Big Data query tools, such as Pig, Hive, and Impala
  • Experience with Spark / Databricks
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Knowledge of various ETL techniques and frameworks, such as Flume and AWS Glue
  • Experience with messaging systems, such as Kafka, RabbitMQ and AWS Kinesis
  • Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
  • Good understanding of Lambda Architecture, along with its advantages and drawbacks
  • Familiar with visualisation tooling, such as Tableau or AWS QuickSight
  • AWS or Azure certification would be a bonus

The Role:

The Data Engineer will consult on collecting, storing, processing, and analysing huge sets of data for clients. The primary focus will be on identifying and architecting optimal solutions to client problems, then implementing, maintaining and monitoring the solution.  The Data Engineer will;

  • Be able to understand client datasets and requirements
  • Able to Select and integrate Big Data tools and frameworks required to provide requested capabilities
  • Implement ETL process and pipelines
  • Implement dashboards and reporting, including monitoring performance and identifying areas for improvements
  • Define and implement data retention policies

Full Job description is available on request

To apply:  Please follow the online application process and upload your CV, in Word format

Please note: You must be eligible to work in the UK for your application to be considered (sorry, our client is unable to offer sponsorship).  Due to large numbers of applications, unfortunately we cannot provide detailed feedback to everyone, however, if you wish to find out how your application is progressing please call or e-mail the office and someone will help you / get back to you.

At Solo Search we take your data privacy seriously, by applying for this vacancy your data will be processed and likely stored on our secure internal systems. The lawful basis Solo Search use to process your data in regard to this application is legitimate interest and without further consent, your details will be stored for a maximum period of 12 months only. We will only ever use your data to assist you with your job search and this data will not be shared with any third party, including the client, without your explicit consent. Our full Data Privacy Policy can be viewed on our website.