Скачать или смотреть Mastering Long Monitoring with National Instruments using Python

Discover how to successfully implement long-duration monitoring experiments with NI's NIDAQmx module. Streamline data acquisition and manage memory efficiently in Python.
---
This video is based on the question https://stackoverflow.com/q/66984522/ asked by the user 'Thomas Gaubert' ( https://stackoverflow.com/u/15568131/ ) and on the answer https://stackoverflow.com/a/70709408/ provided by the user 'Thomas Gaubert' ( https://stackoverflow.com/u/15568131/ ) at 'Stack Overflow' website. Thanks to these great users and Stackexchange community for their contributions.

Visit these links for original content and any more details, such as alternate solutions, latest updates/developments on topic, comments, revision history etc. For example, the original title of the Question was: National Instrument Long Monitoring Python

Also, Content (except music) licensed under CC BY-SA https://meta.stackexchange.com/help/l...
The original Question post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license, and the original Answer post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license.

If anything seems off to you, please feel free to write me at vlogize [AT] gmail [DOT] com.
---
Mastering Long Monitoring with National Instruments using Python

In the world of data acquisition, monitoring experiments over extended periods can be challenging. This is especially true when you're working with high sampling rates—like 200 kHz—while trying to keep your data organized and within memory limits. If you've ever faced issues while utilizing the NIDAQmx module from National Instruments to continuously record large amounts of sensor data, you're not alone! In this guide, we’ll tackle a common problem faced during long monitoring sessions and offer you a comprehensive solution.

The Problem: Long-Duration Monitoring Challenges

As outlined in a recent query by a user working with two 32-channel NI PXI 44-98 acquisition cards, they were trying to run a continuous monitoring routine that would last for 10 hours. However, they hit a significant roadblock: the memory limitation of Python made it impossible to store all the data acquired during these long sessions. The initial attempts were falling short, only allowing for about 10 minutes of monitoring.

This situation highlights two primary challenges:

Memory Overflows: The continuous data collection leads to rapid consumption of memory, making it impossible to retain data beyond a certain timeframe.

Data Management: With vast amounts of data being recorded, efficiently writing this data to disk while keeping the monitoring ongoing is essential.

The Solution: Efficient Data Acquisition with NIDAQmx

After conducting thorough research, we've distilled a solution that not only overcomes these hurdles but optimizes the performance of the data monitoring process. Below is a step-by-step explanation of the solution.

Step 1: Define the Parameters

Before diving into the implementation, you need to establish several key parameters:

Sampling Frequency: Set to 200 kHz.

Buffer Size: The size of the input buffer, here set to 800,000 samples.

Channels: In this case, there are 32 channels being monitored.

Path for Data Storage: Establish a directory on your local machine for storing the output data files.

[[See Video to Reveal this Text or Code Snippet]]

Step 2: Implement Data Acquisition Logic

The main component of our solution involves a callback function that reads data in batches and writes them to disk. This ensures that you never exceed memory limits. The code implementation captures the necessary data and saves it in .npy format, very efficient for numerical data.

[[See Video to Reveal this Text or Code Snippet]]

Step 3: Information Update to the User

It's important to provide a way for the user to control the operation. Implement a function that allows the user to stop the continuous acquisition gracefully.

[[See Video to Reveal this Text or Code Snippet]]

Step 4: Execute the Task in a Threaded Environment

By leveraging threading, you can allow the user to terminate the task smoothly while data continues to be collected in the background.

[[See Video to Reveal this Text or Code Snippet]]

Conclusion: A Robust Monitoring Routine

With this structured approach, you can effectively run continuous monitoring experiments that extend beyond 10 hours, without overloading memory and while effectively writing data to disk. Implementing tasks in NIDAQmx along with a proper structure for managing memory and user interaction forms the backbone of robust data acquisition routines.

Feel free to explore further into optimizing and modifying the code based on your unique experiment requirements. Long-duration monitoring is now within your reach with the right tools and techniques!

Final Thoughts

In conclusion, monitoring experiments can seem daunting, but with effective programming practices an