Loading...
Answers
MenuAthena, redshift, bigquery?
Answers
Hello, I'm Muntasir Al Qawasmi
I would like to say, in general terms, that the use of what was mentioned, Google and Amazon are quick and innovative solutions, and if used, it is for backup copies.
But in the case of a large company and a large number of daily data, I recommend creating a special program using Python that reads the data and delivers as appropriate for your business policy
I have been helping clients design, build, and deploy data platforms for many years. Initially on premise, but now in the cloud. I think your choice of technology is less important than your chosen data architecture. I would focus on defining this data architecture first (i.e. to satisfy your requirements) and then looking at how the Azure, AWS, or GCP clouds could best satisfy your requirement. I would consider things like data ingestion, orchestration, modelling, and exploitation. The biggest challenges won't be technology, but thinkings like 1) how do you model the data to answer your questions and 2) how do you relate/join the various data sources. I hope this helps; feel free to pop in a call of you would like to delve into more detail or if you have any questions.
Related Questions
-
How can I assess the value of my data assets?
I have been helping clients design, build, and deploy data platforms for many years. Initially on premise, but now in the cloud. This is a really good question. My immediate thought is, yes, there is value in this data. The more difficult one to answer is where and how? The obviously answer is monetisation i.e. what would people or organisations be willing to pay for this data. More importantly, is this my data (vs. customer data) to sell? The data may also represent your intellectual property or be your "secret sauce" so you might not necessarily want to sell it. It is then worth asking questions like "what would the impact on my organisation be if I did not have this data?" or "what would the impact on my organisation be if my competitors had this data?". Hopefully this has given you some ideas. Feel free to book in a call if you have any questions or would like to delve into the detail.GR
-
How do I find the Total Addressable Market for a Big Data product like Datameer?
As someone who has built TAM models for various industries - I can attest this isn;t always easy. Many analyst firms (former analyst here) typically do some surveys and research among public company revenue reports for the year and then do some pixie dust extrapolating. The hard thing about a market where startups like Datameer play is that it is a) a nascent market and b) not a "zero sum" game. This makes it difficult to a) fully understand WHICH companies actually are in the market for this flavor of BI and b) know how the space is developing in terms of white space AND disrupting the entrenched BI giants. You might want to look at the press published versions (read: free) of analyst market share reports, and extrapolate from their. Also, back-channel gossip may give you some revenue numbers on these players - and if you assume pipeline is 3-4x revenue, build a model from there. Hope this helps.MS
-
How do I set up a WordPress MU site using multiple databases? The site will become very large if it's all on one database.
Check out these WordPress plugins: https://wordpress.org/plugins/shardb/ and https://premium.wpmudev.org/project/multi-db/ Good luck!BB
-
Is there demand for a service that sells database of contact information of varied sectors and geographies? If so, how do I market this product?
There are a lot of players in this market. Many that integrate with all the major CRMs and append and clean data. I would say I get at least 1 email a day from a data vendor and I have been on countless demos and calls and because my client is so niche they never have more 5-10 records even viable for me. I am sure for larger companies with broader markets this works well. They all tend to have very aggressive sales outreach. I have one company that has called me every 3 months for the past 2 years. At this point hes basically just asking about my health and the weather :)NP
-
Licensing points of interest database vs. creating your own when creating a mobile app MVP?
Using Google Places API and storing the results in your own database likely violates the terms of service. Likewise, you are limited to the number of calls per day to the API. If you expect users to appreciate (and pay for) the software you are generating, you should do likewise. Go with the licenced database.BM
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.