Loading...
Answers
MenuHow can I create a searchable large (3 million record) searchable database in WordPress?
Client has a database with millions of records on teacher and public employee salaries over the past 10 years for Ohio. They want to redesign their website and move it to WordPress -- any suggestions?
Answers
Well first off I wouldn't recommend trying to power your client's database with the standard WordPress database instance. They can use WordPress for the website all they like. But with millions of records like that, you really don't want to move those data in with WordPress.
For that matter, you're probably gonna want a dedicated database server to answer those questions, if the client doesn't already have one. You might also need to investigate something like Elastic Search, depending on what your search requirements are and what sort of database they are using (pay close attention to whether or not it provides full text search ability).
Beyond that, and somewhat obviously, you're also gonna want SSL on the website and to make sure you're up to date on federal and state privacy requirements for data like this, as well as best practices for securely transferring data over the web (port configuration, ssh keys, etc).
The privacy concerns would raise a flag for me. If those data have anything personally identifiable in them - which they very probably do - then you're really gonna want to make sure you do your research on security of personally identifiable information. Government specific privacy /security /auditability requirements may also apply, so double check that too.
You need to hire a WordPress consultant to help you with that. If you email me at http://bradt.ca/contact/ with an approximate budget, timeline, and details about the project, I can forward it to freelance consultants I know.
I would look into a knowledgebase sort of wordpress application. For example http://debthelpdesk.org is a site that has their search built into blog posts, faq entries, files, forums...basically any public information they have setup on the site.
I believe this is the plugin that was built into their theme http://codecanyon.net/item/knb-wordpress-knowledge-base-wiki-shortcode-/full_screen_preview/8937609
You will also need a developer to allow for you to automatically upload a spreadsheet of data to make things easy
It's not clear from your question, but I'm assuming your client wants a frontend built in WordPress for this data. So assuming you'd be building a custom plugin.
Depending on the data structure, it may be best to keep this data in its own tables - within the same WP database if you like.
You can indeed create custom post types in WordPress and store any kind of data. But you may hit performance bottlenecks when you want to perform searches or want data in particular format.
We've built and tested some of our plugins with millions of rows of data. When we need higher performance, we've used our own tables inside WP. Rather than relying on WP's core data structures.
Hope this helps. And I'd be happy to answer any specific questions you may have.
I would advise for such a monster DB to keep it external to wordpress. Use elasticsearch for the DB and create an external service/api to be accesible from the WP site.
I believe these links will greatly help you when you sit creating large searchable database in WordPress:
I.
https://wordpress.org/plugins/inline-google-spreadsheet-viewer/
II.
https://wordpress.org/plugins/custom-database-tables/
III.
https://wordpress.org/plugins/custom-database-applications-by-caspio/
IV.
https://wordpress.org/plugins/wptables/
V.
https://wordpress.org/plugins/tabulate/
Also, have a look at this link: https://www.data.gov/local/get-local-government-data-gov ?
Besides if you do have any questions give me a call: https://clarity.fm/joy-brotonath
Related Questions
-
I want to build a expert marketplace directory listing website, which wordpress theme I should use?
Checkout is a high-quality WordPress theme by Array built for marketplaces of any kind. https://arraythemes.com/themes/checkout-wordpress-theme/ Let me know if you have any questions about implementation, and I'd be happy to setup a call.Lara LittlefieldLL
-
What's the best way to build a MVP web app that handles order management, purchasing, invoicing, supplier management and inventory?
The best way to build an MVP for any SaaS product is to create a landing page that looks like a real product. Here's an example of one I built. http://www.happiily.com In this case, it advertises the primary features of the product and invites people to sign-up. When they do, they are asked for information which qualifies the person and then sends me an email. I built this quickly and very inexpensively and started getting inbound leads from it shortly thereafter. I got on the phone with each person who signed-up and explained the features I wanted to build and was able to do a lot of customer learning based on that. Happy to talk to you in a call if you'd like to talk more about customer development with SaaS products.Tom WilliamsTW
-
Can a WordPress site be converted into an iOS app?
Be careful when simply wrapping things into a mobile app. This can backfire on you and you could be presented with some very harsh edge cases. PHP isn't going to be encapsulated so much as the HTML/CSS/JavaScript. So keep in mind your mobile application could likely be in a position of requiring an online connection to work (because it must interface with your existing hosted WordPress site). This could also mean your hosting solution needs to be evaluated to ensure you can handle any increased traffic (and those traffic patterns could be different when coming from a mobile app that perhaps loads things the user doesn't see right away, accesses content that may not be cached, etc.). You want to ensure your server doesn't go down because then your mobile app would be "down" as well. That said... Things like Phonegap (web views) are a wonderful idea for utility apps because the performance is good enough for those (and hey even some games) and they end up being easily ported across many mobile operating systems. I would look into Phonegap, Appgyver (a new and totally awesome one because parts of it will utilize the native OS and your app will feel more responsive), Appcelerator Titanium, and perhaps even the new Famo.us one. Also take a look at the Ionic Framework for some further ideas about mobile UI and what you can do with these web view style apps.Tom MaiarotoTM
-
Is it possible in woocommerce to display Shipping methods first on the checkout page?
Yes. https://docs.woothemes.com/document/configuring-woocommerce-settings/Shaun NestorSN
-
What should my consulting rates be as a freelance developer who can also do SEO, social media optimization and other marketing services?
Pricing for different tasks that require the same amount of time from you tells the Customer (and your subconscious) that you're working at a 5 on task x, but working at a 9 on task y simply because it costs/earns more. That seems to be a disconnect. Your time is your most precious asset, and I would charge for it whatever you're doing. If you build a site, and they are happy with your dev fee, but feel like you should charge less for SEO, simply let them find another SEO guy. That's their choice, but YOU are worth $xx.xx, no matter what you're doing. Also, in general, take whatever you're charging and add 10% to it. If you're still busy, add another 10%. Let the demand level determine how much work you do, and at what cost.Sam LawrenceSL
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.
