Data Analyst
You will be developing a web scraping tool for scraping specific information from the open domain and performing analysis to generate insights and transform data into desired formats.
View full description
What you will be doing
- Develop innovative web scraping mechanisms that satisfy the needs for specific information
- Perform data analysis on large amounts of data for insights generation
- Interact and cooperate with enterprise level solutions and software configuration workflows
Requirements and skills
- Must Professional in any scraping framework or tool (Scrapy, Beautiful Soup, Selenium, Puppeteer, PySpider, Octoparse, Portia, Content Grabber, etc.)
- Must Professional in Java, JPA, Python, and MySQL
- Must Good English and general communication skills
- Must Experience with MinIO, Ceph, or S3
- Must Experience with big data and cloud computing (Spark, Hadoop)
- Nice to have Understanding of general zone file format
- Nice to have Experience with Azure and/or AWS cloud service providers