Update data structures to store all information
list > np_list > pd.Series > np_array @ subsets <= 100 : Matching Performance using Python list‘s, ndarray‘s, and pandas – Benjamin M. Gross
- Determine the best structure
- Do you need to calculate duration? How often is it used? Worth saving as a variable or calc'ing on the fly?
- What to do if there are comments at the end of the SMPS file?
- Depending on CCNC Data structure changes, update CCNC to pull 150% of the number of rows instead of 25% (If this is needed, make a new issue for this task as it will have repercussions on the auto shift algorithm)
- Ensure variables kept are okay? e.g. currently raw avg CCNC sizes is not used.