Lead Big Data Engineer (AWS)

WE ARE

SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our team is passionate innovators working on over 2,000 cutting-edge projects worldwide from the USA and Europe to the Asia-Pacific region.

We are a Big Data & Analytics Center of Excellence, a data consulting and data engineering branch of SoftServe. We are cooperating with a titan in the energy sector, dedicated to innovating and investing in clean energy electrifying across 49 states in North America. Their storied history of corporate responsibility, operational excellence, and relentless innovation has not only earned them widespread recognition but also solidified their commitment to pioneering new technologies in the energy landscape.

SoftServe embarks on this thrilling journey with the client, therefore we are assembling an elite AI and Data Project Team of professionals to drive innovations in the energy and logistics domain. Our team plans to have more than 20 members in the first year, with some based on the East Coast of the USA and others in Warsaw and Wroclaw.

IF YOU ARE

• A seasoned professional, focused on data pipeline creation and comfortable with batch processing and streaming processing
• Used to leading a team or considering yourself ready to do it
• Experienced in Python and SQL
• Skilled in data solutions development within AWS (additional cloud experience is a plus)
• Confident in Apache Spark, Databricks, Flink, Apache Airflow, MWAA or similar
• A practitioner of Apache Kafka, MSK, or Kinesis and Amazon Redshift, or Snowflake
• Willing to learn new skills and adjust to a changing situation quickly to hit the ground running on new projects
• Skilled in Scala or Java (would be a plus)
• Possessing a background in AI / ML-related projects and a profound understanding of this domain (not a must but a big plus)
• An effective communicator, demonstrating fluent speech at the Upper Intermediate+ English level

AND YOU WANT TO

TOGETHER WE WILL