Logistic Management
Customer Profile
With clients all over the world and individual delivery consists of a multitude of processes, data generation is done at break-neck speed. Just keeping up with the volume and velocity of data would stop anyone from analysing it. It usually is because by the time a business proposition is made, it would quickly become irrelevant based on the new data that was generated.
Challenges
Volume and Velocity are not the only problem. Like many company that has been operating for years, the technology resources tends to be varied. Database of all kinds and hosted by many different vendors makes it difficult to bring them all together for a cohesive analysis. The challenges that a client would face would be:
- There would be more than one database that used to host different types of data, with no clear indication if there are duplicates or what is being collected (besides the person in-charge of the database)
- Data is not readily accessible as most of the employees does not know how to query a database – the data needs to be presented in a simpler format
- Overtime the data becomes dirty or incomplete, making it useless for analysis
- Hosting huge amount of data can be expensive, and some might cut cost by having them on the same server which is highly dangerous. When one goes down, all services stops!
Solutions
Everything starts with a great roadmap, detailing a plan for the next few time period and what the future will look like. With our blueprint, the client would be able to understand the current infrastructure that they have, some of the weak points, and areas for improvement to increase the bottom line.
We then get to work of building a data warehouse to be the new control center for all analysis. Instead of traversing different databases, users can now get all the data (with ETL to clean them up) they need from one source without worrying about impacting the performance of production servers. This can be done cost effectively using cloud solutions such as Amazon Web Services and Snowflake.
To make the data accessible, a dashboard is created using Microsoft PowerBI for users to access the data they need with all the analysis pre-built for them, saving them time with having to continuously build with Excel.
Proposed Architecture
