data engineer | budapest

megjelenés dátuma
zsanett horváth, randstad hungary
állás típusa
határozatlan idejű

az állás részletei

megjelenés dátuma
IT / telekom
állás típusa
határozatlan idejű
156189 / 24117
zsanett horváth, randstad hungary
Nem kötelező önéletrajzot feltöltenie ahhoz, hogy megpályázza ezt a pozíciót, sőt egyszerű megoldásként akár a Linkedin profiljával is jelentkezhet. Kattintson a jelentkezem gombra és válasszon a maximum 2 percet igénylő jelentkezési lehetőségek közül.

Cégleírás / Organisation/Department

What we do? We have a global identity verification solutions to help companies
identify legitimate customers.

How we do it? Our real-time data integrates into existing platforms, authentication
workflows, and data models. Our foundation is data at massive scale

How is the team look like?
Data services team is responsible for managing the Global Identity Graph, which holds and serves all identity information. Backed by proprietary state-of-the-art Graph Database, and populated by Spark based big-data ingestion pipeline, serving hundreds of thousands of request per second at low latency.

Pozíció leírása / Job description

What will you do?
In the Big data Engineer role you will:

Design and development of processing large data files as per product requirements using Spark framework.
Develop deep understanding of Spark and its internals to continually optimize the ingestion pipeline.
Maintain sufficiently generic yet simple and economical solution.
Insist on highest coding standards, follow and create best practices for clean code and architecture.
Manage a sense of urgency and risks on project timelines and proposes creative strategies for delivering constant business value.
Develop deep understanding of data, get a good sense of signal vs noise to help business with shape new products.

Elvárások / Requirements

Experience building complex ETLs, Data Warehousing or custom pipelines from multiple data sources, including proper monitoring, alerting, verification, and metrics in a commercial environment.
Experience with the Spark ecosystem in production environment.
Experience with Databricks and related platform.
Experience working with extremely large datasets, using tools such as Spark, Hadoop.
Fundamentals around JVM and garbage collection optimization understanding.

Amit kínálunk / Offer

-Training and development opportunities in a global organization
- Possibility to work with new technologies in a global project
- Company events
- Competitive benefit package
- Development and career prospects
- Stable company background

Kapcsolattartó / Applications

Zsanett Horváth