On the morning meeting with Steve and Wayne. Light catch-up from missing a week at scout camp. We then got a small demo on some of the code that Wayne is writing for the data transfers and data migration stuff. He is adding in universal unique identifiers (UUID's) and data check sums. On the data check sums, Wayne was taking in all of the data, fields, and values. He was then putting all of that together, running a special hash on the data, and the storing the smaller hash value. Then later on, he could compare that smaller hash value to another smaller hash value to see if any of the other pieces had changed. So, in real life, imagine a database table that has 50 columns of data and thousands and thousands of records. If each record (set of all 50 columns worth of data for a single record) could get a small little hash for the grand sum of the data. If anything changed, the mini hash would then change. This helps so that you don't have to individually check each of the columns and data to see what has changed. Great idea and huge time saver.

This is also really important for migrating data while a customer is working on things. If the hash remains the same, you know you have the latest data (all synced up). Very creative. You just need to make sure and update the small check sum if anything changes. That is kinda the key. This is the same process as a last modified date, but deals with data vs dates. Similar concepts.

Part way through the day, we got called out and had to do some major work and checking on the data 2 server. There was tons of web/API socket activity and it was bringing the server to its knees. We ended up disabling the data 2 API socket access port and did some checking on the local server. There had been over 72,000+ web/API calls this morning alone. We figured out that many of the calls were dealing with full invoice details and customer data look-ups. That raised some questions. After running a number of queries, we had some conversations about dedicated boxes, API socket access, and how to help monitor and load balance things. See attached for a few of the queries that we ran on the data 2 box to check things out.