Please propose a solution design for my case. The data comes from various sources, some from api, some from csv. A user will search using filters. Ex: Product data (source 1) and Product Reviews ( Source 2). A user will search for a product with its name and rating. Considerations:
- When product reviews will keep on changing. So, the search should reflect that information.
- In future, some more sources will get added and additional filters will get added. Ultimately, only products will be shown to the users.
- Product price will change. The search results should give updated information.
- The search should be very fast.
I looked into using apache airflow, mongodb and elastic search. However, i felt i am complicating the solution.
