Lead Big Data Engineer

Responsibilities

• Lead, design and implement innovative analytical solution using Hadoop, NoSQL and other Big Data related technologies, evaluating new features and architecture in Cloud/ on premise/ Hybrid solutions
• Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
• Build collaborative partnerships with architects and key individuals within other functional groups
• Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution
• Actively participate in code review and test solutions to ensure it meets best practice specifications
• Build and foster a high performance engineering culture, mentor team members and provide team with the tools and motivation
• Write project documentation

Requirements

• Wide experience in analysis, design, implementation, deployment as well as troubleshooting and rebuilding distributed Linux based platforms and Big Data solutions on premises and in Cloud
• Experience in Big Data technologies - including Hadoop Core, Apache HBase, Airflow, MapReduce, Spark, SolR
• Solid Cloud experience with 2 or more leading cloud providers (AWS/Azure/GCP): Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service (SageMaker; Tensorflow)
• 5+ years' experience in software development with Big Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning) and Java/Scala or Python
• Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, Security
• Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
• Strong experience with data modeling; hands-on development experience with modern Big Data components
• Cloud: experience in designing, automation, provisioning, deploying and administering scalable, available and fault tolerant systems
• Good understanding of CI/CD principles and best practices
• Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication skills
• Data-oriented personality and possessing compliance awareness, such as PI, GDPR, HIPAA
• Motivated, independent, efficient and able to handle several projects; work under pressure with a solid sense for setting priorities
• Ability to work in a fast-paced (startup like) agile development environment
• Strong experience in high load and IoT Data Platform architectures and infrastructures
• Vast experience with Containers and Resource Management systems: Docker, Kubernetes, Yarn
• Experience in direct customer communications
• Experience in technology/team leading of data oriented projects
• English proficiency – B2 and higher

We offer

• Diverse multicultural, multi-functional, and multilingual work environment
• Global scope, international projects in different business domains: life sciences and healthcare, retail, and distribution, software and hi-tech, etc
• Outstanding career development opportunities with a transparent career path and a roadmap to accelerate your journey
• Numerous opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to LinkedIn Learning courses
• Knowledge-sharing with colleagues from EPAM's global tech communities
• English language courses
• 25 days holiday per annum
• 5 days of sick leave without medical certification
• Private health insurance for employees and discount for private health insurance for family members
• Discount for Fit Pass program
• Comfortable modern offices in Belgrade and Novi Sad or remote work from any location in Serbia
• Regular corporate and social events (parties, sport events, advanced CSR programs etc.)
• Learning programs for kids (eKids)