upsfeup
September 18th, 2008, 07:46 PM
I'm working in a personal project and I'm having some problems that you might help.
My project consists in gathering and processing a large amount of data received in the serial port in windows environment. The input of information is constant.
The program should read the input by line and display it in a "table". (Data is composed by an ID and a data field.
Problem 1: The program should log the data in to a file (this is not really the problem) and at the same time display it on the screen. I wanted a system that could filter the displayed data on real time (by ID) while still storing and processing all the data in the background - disabling the filter should show all the data including the new one that is being received.
So.. challenge number one: How to display (table) a very large amount of data in realtime.
Problem 2: The data field is composed by a string of Hex numbers. The string can have a different meaning depending on the ID of the data. Most of them are bitfields. Others are in BCD format. Others are.. I'm trying to find that out.... I need a way to convert strings to numbers in a readable format.
Challenge number two: which language would give the best performance to deal with the strings and numbers?
Problem 3: The program will be used to debug, test and analyze the information so it has to be dynamic and would optimally be able to change the way the information is displayed and highlight any changes between data packets.
Challenge number 3: Speed is in the essence while having customized display of the data.
Now.. I've started with perl which gives a good grip on the data but no GUI. the command line is a bit too powerless to all the things I want to do. Also I noted that with too much data it starts to lag ...
I made a small incursion in VB because of the customized data tables. It was wayyyyyyy to slow to handle the data (even to display it in a text box)
Now.. I have some experience with C and C++ but I must confess it was a long time ago and there are a lot of stuff I don't quite grasp (those **** pointers of pointers and MFC always had me..) but I sure willing to get my hands (very) dirty.
Also, I'm willing to learn new programming languages. This project is my first incursion in perl and so far so good. (Just stroke me now.. how fast is MATLAB?)
Anyway, thanks for your time. Any help is appreciated.
My project consists in gathering and processing a large amount of data received in the serial port in windows environment. The input of information is constant.
The program should read the input by line and display it in a "table". (Data is composed by an ID and a data field.
Problem 1: The program should log the data in to a file (this is not really the problem) and at the same time display it on the screen. I wanted a system that could filter the displayed data on real time (by ID) while still storing and processing all the data in the background - disabling the filter should show all the data including the new one that is being received.
So.. challenge number one: How to display (table) a very large amount of data in realtime.
Problem 2: The data field is composed by a string of Hex numbers. The string can have a different meaning depending on the ID of the data. Most of them are bitfields. Others are in BCD format. Others are.. I'm trying to find that out.... I need a way to convert strings to numbers in a readable format.
Challenge number two: which language would give the best performance to deal with the strings and numbers?
Problem 3: The program will be used to debug, test and analyze the information so it has to be dynamic and would optimally be able to change the way the information is displayed and highlight any changes between data packets.
Challenge number 3: Speed is in the essence while having customized display of the data.
Now.. I've started with perl which gives a good grip on the data but no GUI. the command line is a bit too powerless to all the things I want to do. Also I noted that with too much data it starts to lag ...
I made a small incursion in VB because of the customized data tables. It was wayyyyyyy to slow to handle the data (even to display it in a text box)
Now.. I have some experience with C and C++ but I must confess it was a long time ago and there are a lot of stuff I don't quite grasp (those **** pointers of pointers and MFC always had me..) but I sure willing to get my hands (very) dirty.
Also, I'm willing to learn new programming languages. This project is my first incursion in perl and so far so good. (Just stroke me now.. how fast is MATLAB?)
Anyway, thanks for your time. Any help is appreciated.