Sunday, July 30, 2017

Learning From Performance Testing/Engineering:


ConcurrentModificationException occurs due to variables declared/used as Class Variables instead of variables are defined under Class Members.

Moving declared class variables in Class Members would help in resolving above ConcurrentModificationException in multi-threaded environment.


Wednesday, June 28, 2017

Performance Improvement To JSON Blobs Reads

The Dynamic Search feature is based on Amazon S3, RIAK KV as backend DB.
While performing Dynamic Search based with one or more than one field values, where large data objects/files are fetched from S3 buckets.

RIAK KV stores the metadata and link to S3 bucket for large data payload.
While searching for a data item with large json blob, ~100MB of data was sent to the client machine degrading the Search API performance.

The recommendation was to send meta data with link to the user and user can choose to download the item by clicking the link (each record of size 1MB, 2MB, 5MB or 10MB) when needed to see his observation data.