For open APIs this is possible but how to do with the closed ones ?
We have some in house technology WCML that we use to mine data on the web. Let me know if we can be of assistance.