At Lambert Labs we specialise in aggregating structured and unstructured data from a range of sources. We use industry-standard Python tools and custom built solutions to scrape text, images and videos from the internet.

Web scraping is a constant fight against the ever increasing amount of website content injected by JavaScript in web browsers. At Lambert Labs we are experts in using the latest tools to access the most inaccessible data.

Our skills include:

  • Combining the Scrapy framework with Selenium to create a powerful scraping system
  • Running headless Selenium browsers on remote servers
  • Using Selenium with custom-built Chrome extensions to give full access to browser content
  • Deep crawling
  • Building generic web crawlers that can extract content from any website