Beschreibung
Our client is looking for a Web Crawling specialist
Start: ASAP
Location: Munich and Essen
Duration: 2-3 months + Extensions
Language: English, German is a plus
Tasks
- Design a data model that can manage data from different industry standards for metering, electrical devices and energy - Crawling external web-sources based on a specific information need, parse and extract data, ingest it into a local database
- Database design and development containing a mix of customer, transactional and community feedback relevant information
- Deployment of the data centric framework within a cloud environment
- Implementation of the information search and retrieval module
Skills
- Practical knowledge in web-crawling techniques and technologies (eg, Jsoup, Apache Nutch, Scrapy) using various temporal and geolocation based information
- Software development in Java, JavaScript, PHP, HTML/HTML5
- Good knowledge in the field of information extraction, indexing, retrieval (eg, regular expressions, Apache Solr)
- Familiar with RDBMS design and development (eg MySQL, PostgreSQL or SqlServer)
- Familiar with Azure Cloud services is a plus
REMOTE WORK AVAILABLE