About the company:
Coherent Solutions is a US based software product development and consulting company that solves client business problems by bringing together global expertise, innovation, and creativity to produce world-class technology solutions. The US-based delivery teams work side-by-side with 1400+ employees globally. North America headquarters reside in Minneapolis, US, with European locations in Bulgaria, Romania, Belarus, Ukraine, and Lithuania.
About the Project and The Role:
Our client is a pioneer in cross-platform media measurement and is a trusted partner for planning, transacting and evaluating media across platforms. With a data footprint that combines digital, linear TV, over-the-top and theatrical viewership intelligence with advanced audience insights, the platform allows media buyers and sellers to quantify their multiscreen behavior and make business decisions with confidence.
About the Role:
You’ll be part of a team responsible for building next generation data delivery platform. Our API is a driver of business growth by providing access to the television ratings metrics for a broad range of clients and products, including industry leading ad agencies, national television networks and other products. As a member of this fast-moving team you’ll have large impact on the evolution and adoption of the API as well as on the success of the business. It’s worth mentioning that this company processes and stores dozens of petabytes of data which is coming from Web and their current infrastructure processes 15 bln requests per day.
Service consists of two applications connected by the queue. First, one is the API web-service that accepts user requests (with JSON payload), validates them and pushes to the job queue. Second is the data engine implemented as a long-running Spark application deployed on the EMR cluster. Data engine pulls job requests from the queue, builds Spark jobs from JSON payload and runs these jobs on the cluster. When the job is done, the result is pushed back to the web-service via queue and returned to the client. It is important to note that all the data engine use is preprocessed and pre-aggregated already and stored as parquet files. So the only thing engine does is running a client queries against this data. As a result, the tasks to work with are related mostly to both Spark engine and API (we use Akka here), performance testing and optimization (again, API and engine), messaging (currently we move from SQS to custom Redis-based implementation), DevOps (Jenkins, Docker). Scrum is used as a development methodology. Tickets/tasks are not assigned strictly, it is always possible to pick any one interesting to you from the backlog.
Your Essential Duties will include:
Technologies: Scala, Bigdata, Apache Spark, AWS
The technical skillset we are looking for would be:
Why joining Coherent Solutions?
Coherent Solutions is a stable growing company with more than 25 years of history. Our Sofia office has been opened in 2018. For every professional, we are ready to offer working conditions that will reveal your potential in the best possible way. Knowledge, personal skills and real work experience are the only criteria for evaluating candidates in our company.