Tech - NOSQL Tutorial - Part 3 (Performance)


​As promised, here are the results of the database shoot out between MongoDB and SQL Server. Before we get into the results, a few things worth noting. The objective of the performance test is a simple use case - search data based on some keys. I have a few self imposed principles to ensure that the test is fair and square -

  • Use the standard configuration for the databases so that it's a fair comparison.
  • Exactly the same data loaded into both the databases, including creating the same kind of indexes too.
  • Exactly the same queries and parameters used for both the databases.
  • Exactly the same client used to execute the queries against both the databases.
  • The same kind of OS and underlying hardware (CPU, RAM etc).


There are 3 separate database servers that have been used here. They are -

  • Server 1 - Windows 2008 R2 (64 bit) physical server running MongoDB (64 bit).
  • Server 2 - Windows 2008 R2 (64 bit) virtual server running MongoDB (64 bit).
  • Server 3 - Windows 2008 R2 (64 bit) virtual server running SQL Server 2008 (64 bit).


And, here are the results. The query times mentioned here include time taken to complete all the steps - open the database connection, execute the query, read the results and close the database connection. To give a better perspective, the min, max and the avg times have also been included. It's interesting to note that the average time that SQL Server took is the maximum time for a MongoDB server. Mind you, SQL Server has not fared that badly except the Max query time, but even on the others I didn't expect MongoDB to be so much quicker than SQL Server.

I personally do like skyscrapers, but in these charts, the shorter the better! I think I have been a bit spoilt now, any reponse time greater than a second by any server is going to feel like a let down. ;)


However, let me again remind that typically NOSQL databases like MongoDB cannot do complex queries, table joins, triggers, ACID and the other features that a typical RDBMS can excel in. If one wants to prove capability of RDBMS, just throw a complex SQL at a MongoDB. But, when it comes to fast reading/writing of data, then NOSQL database probably win hands down. Of course, it also depends on how the overall solution is designed. As I said earlier, horses for the courses.

In a later post, I will probably cover some scenarios where NOSQL databases could be used.

Click here for - Part 4.
Location: Welwyn, Welwyn, Hertfordshire, UK

Comments

Post a Comment

Popular posts from this blog

Meta Prompting for Success

Image
Meta Prompt  Regardless of the Generative AI model used, sometimes the model may refuse to provide a response for a valid prompt. Often the reasons cited are - "I don't know", "I am not trained for the task", "violation of safety/responsible/ethical guardrails". This is sometimes more acutely felt when using Generative AI models for creating images. Overcoming this behavior can be frustrating and time consuming. An approach is to ask the AI model itself to generate prompts so that the prose and nuances of prompting are aligned with how the AI model has been built. This is called meta-prompting . The theory is that the prompts created by the AI model would have better chance of working. Let's dive in to see if and how this meta-prompting works in Gemini .  How to Create a Meta Prompt As with all good prompts, start with a persona/situation that describes the overall context. Next, describe the task in detail. In this case, it is about creating some ...
Read more

Book Review - The Price of Being Fair

Image
Overview  As the FairPrice group in Singapore completes 50 years, "The Price of Being Fair" book is a timely story of it's birth and evolution. The book has been authored by Sue-Ann Chia and Shing Huei Peh. While being true to history, the book has nuggets of "behind the scenes" information, given the time the authors have spent with various leaders at FairPrice. The book is already a best seller according to Kinokuniya book store. At under 200 pages, it makes for a breezy read. The Usual Suspects Having worked in retail industry for over two decades, the travails of  NTUC FairPrice seem familiar to me. A retail CEO once remarked that retail is a pretty "public" industry. There is not much behind which a retail business can hide. As such, retailers often have to follow the aspirations and concerns of the communities and customers they serve. The journey of FairPrice from being an EDLP (everyday low price) retailer to one having multiple formats, busin...
Read more

How to create a big picture

Image
Typically, you need wide view or fisheye lenses to capture a panoramic picture. An alternate method (though may not give the same quality) is to use software to create a panoramic image. There are several software available which you can use to create a panoramic image. The concept is called - "stitching". Some of the software available are - PTGui, Panavue, PAX-it, AutoStitch and so on. I sometimes use AutoStitch to create the panoramas since I have a 50mm lens for now. Each of these software vary in price and features. The added advantage is that you can take the pictures using any kind of camera - digital, phone or SLR. Steps: 1. Visualize the picture you want to take. 2. Use your camera and "divide" your image into rows and columns. An example being - 2 rows and 5 columns. 3. Take 10 pictures to cover your entire image. 4. Use any of the software to "stitch" them together. Here is an example of a panorama created using AutoStitch. I to...
Read more