Automanager E-mail Scraper

This usecase is a part of complex platform "Automanager" - The Marketplace for wholesalers and retailers for auto tires and rims.

The essence of the project is that all wholesalers regularly send their emails with nested price-lists to the particular service email address. Not so hard to organize it. Each wholesaler is interested in sharing their business information.

E-mail message example

Each email message from wholesaler looks like usual email with an undisclosed file. Sometimes it contains few files.

Or one file can provide a few included sheets. It means we should handle all these cases and exclude the situation when some of the spreadsheets have missed.

Recognizing of senders

Also the system should recognize which message belongs to which company. And sometimes it could be sent from a few different company email addresses. So the database of restricted senders helps us with it

Results log

Each new file and each new sheet in the table generates new task in the Tasks Queue. The process of handling these raw data is a different use-case. We can see results of it's handling in the Import Log. It contains error messages if something happens during the handling process.