Ovaj posao je objavljen pre vise od 40 dana, mozda vise nije aktivan!
Big Data Engineer
We are seeking a SCALA developer who can assist with big data project on daily basis. This project assumes engagement on daily basis in order to extend existing team's capability for data processing including collecting, managing, parsing analyzing and visualizing big/large sets of data. This role also includes working with machine learning models applied to big data digested in order to complete the product requirements.
Job location: Belgrade, Novi Sad or remote
Working on big data project with different file types and formats
Parsing GB's files in size with full respect to server capacity - multiprocessing and multithreading experience required
Parallel data processing and storing results on remote servers
Writing comprehensive scripts to perform data calculations between databases and files containing GB's of data and all with full respect to server capacity
Working on process automation to deliver fast data processing with as much as human interaction as possible.
Experience with SCALA programming language development
Experience with Apache Spark and it's components
Knowledge of cloud computing platforms
Long-term experience in OOP programming
Understanding multithreading and multiprocessing
Experience with No-SQL and relation driven DB engines
Understanding of UNIX based systems and system programming
Experience in handling data concurrency
Experience with data formatting - JSON experience with generating and parsing
Experience with bash programming