AnsweredAssumed Answered

How to convert binary (.bin file) to ascii file?

Question asked by Matjazz on Dec 15, 2019
Latest reply on Dec 31, 2020 by Matjazz

Like • Show 0 Likes0
Comment • 24

Hi!

how can I convert .bin file to ascii file (.txt, .csv or any other type)? I want to make conversion on computer using some script and then analyze acii data in Originlab. The binary file has 40 segments (i.e., waveforms) for each of the four channels. I found Phyton and C scripts on Keysight website to read bin files but they don't work. I don't have Matlab to read binary files. Why doesn't Keysight provide simple converter from binary file to ascii file? What's the point of providing binary format if one cannot read it? Please help, I'm getting desperate here! I am working with large data sets and I cannot save files in .csv format because it takes minutes to save the data. I need to work with binary format.

Thanks,

Matjaz

p.s. I'm using DSOX3034T Oscilloscope but binary files should be the same for all InfiniiVision Oscilloscopes.

pat_white

Dec 17, 2019 7:40 AM

Correct Answer

Hi Matjaz,

I just posted a Python 3 example program for this at: www.keysight.com/find/3000TX-Series-examples

Best Regards,

Pat

See the reply in context

No one else had this question

Outcomes

24 Replies

John475 Dec 16, 2019 2:04 AM
Mark Correct
Correct Answer
Hi Matjaz
I think you should be able to use a hex editor to do that, most will allow you to export in various other formats.
Try HxD mh-nexus.
John
Like • Show 0 Likes0
Actions
- Matjazz @ John475 on Dec 16, 2019 3:02 AM
  Mark Correct
  Correct Answer
  Thanks John but hex editor doesn't help me much. The problem is that the header structure of the bin file with segmented data is very complicated (see attached image from the scope's manual). One needs a script/program to make sense of the binary data. I think that Keysight should provide a script or executable program that would convert all the binary data into ascii. I shouldn't spend my time searching for this on internet and forums. This is very basic thing that should be provided with the oscilloscope or at least be available on their website.
  Matjaz
  Like • Show 0 Likes0
  Actions
pat_white Dec 17, 2019 7:40 AM
Unmark Correct
Correct Answer
Hi Matjaz,

I just posted a Python 3 example program for this at: www.keysight.com/find/3000TX-Series-examples

Best Regards,
Pat
1 person found this helpful
Like • Show 1 Like1
Actions
- Matjazz @ pat_white on Dec 18, 2019 12:57 AM
  Mark Correct
  Correct Answer
  It works! Thank you Pat. This is exactly what I was looking for. You made my life much easier :-)
  
  Cheers,
  Matjaz
  
  p.s. for those who don't know how to use Python scripts.
  1. download and install Python (Download Python | Python.org)
  2. download the attached script, rename it to bin_to_csv.py and copy it to some directory together with your binary files (e.g. put everything in "c:\scope")
  3. run command prompt (in Windows click on Start and type cmd). In cmd go to directory where you have the script and your data (in cmd type: "cd c:\scope")
  4. run the script on your binary file (e.g. "data01.bin"). Type in cmd: python bin_to_csv.py data01.bin. This command converts binary data into ascii (.csv) for each segment and channel.
  Like • Show 0 Likes0
  Actions
- Matjazz @ pat_white on Mar 9, 2020 2:47 AM
  Mark Correct
  Correct Answer
  Hi Pat,
  I have one more request. Can you please write a script that exports only channel 1 and channel 2 to csv format and runs through all bin files in the directory?
  Thank you,
  Matjaz
  Like • Show 0 Likes0
  Actions
  - pat_white @ Matjazz on Mar 9, 2020 9:04 AM
    Mark Correct
    Correct Answer
    Hi Matjaz,
    
    Attached is a script with the two additional modifications. The --labels option lets you list the waveform labels you want to process, for example, --labels 2 D0-D7.
    
    Best Regards,
    Pat
    Attachments
    InfiniiVision_bins_to_csv.py.zip2.5 KB
    Like • Show 0 Likes0
    Actions
    - Matjazz @ pat_white on Mar 10, 2020 4:40 AM
      Mark Correct
      Correct Answer
      Thanks Pat, it works fine. Can you tell me what does "D0-D7" command do?
      Matjaz
      Like • Show 0 Likes0
      Actions
      - pat_white @ Matjazz on Mar 10, 2020 7:47 AM
        Mark Correct
        Correct Answer
        Hi Matjaz,
        
        The "D0-D7" is the default label used for digital channels 0-7. In the .bin file, channel labels are used to identify waveforms. The default label for channel 1 is "1", and so on. You could change the label for channel 1 to something like "CS" before saving data to the .bin file; then, when getting data out of the .bin file, the waveform label is "CS" instead of "1".
        
        Best Regards,
        Pat
        Like • Show 1 Like1
        Actions
  - Tardz @ Matjazz on Mar 9, 2020 9:33 AM
    Mark Correct
    Correct Answer
    Hi,
    
    What information do you need in file, It is just stored DATA from CH1 and CH2 ?
    If yes, in this case, you will have no time information, just 2 columns like on picture below.
    A csv file will be 1.6 bigger than bin file if just DATA of CH1 and CH2
    
    For example the bin file
    
    A csv file will be 1.6 time bigger than bin file if just containt DATA of CH1 and CH2 (Y data)
    
    I will analyze your request for software modifications that I made for you (bin to png).
    
    Yves
    Like • Show 0 Likes0
    Actions
    - Matjazz @ Tardz on Mar 10, 2020 4:46 AM
      Mark Correct
      Correct Answer
      Hi Yves,
      I only need data from CH1 and CH2 to plot the curves. In this way, I have a lot of freedom to customize the graphs (e.g., font size, colors, lines, etc).
      Pat's code works great. I can get all the data including the time scale. However, for each channel and segment I get a separate csv file (column1 is time scale and column2 is channel data). If possible, it would be great to have one csv file with following columns: CH1 (seg1), CH2 (seg1), CH1 (seg2), CH2 (seg2), etc… The time scale I could get from Pat's script.
      Thanks,
      Matjaz
      Like • Show 0 Likes0
      Actions
      - Tardz @ Matjazz on Mar 10, 2020 6:42 AM
        Mark Correct
        Correct Answer
        Hi,
        
        For time scale, there are 2 informations (relative and absolute):
        1- position of trig in segment: value of time is relative and its value is 0 at trig position. In your files TRIG is set at beginning of second div (based on 10 div).
        2- absolute time based on first TRIG (first segment).
        
        If you want one segment by column, all segments have same time scale, we must use relative time information.
        I suppose in this case that you want the first point to have 0 seconds as start time and that each following point has an increment linked to step X value...it is correct ? (see sample csv)
        
        Yves
        Attachments
        2020-01-09_11.csv.zip381.7 KB
        Like • Show 1 Like1
        Actions
        Matjazz @ Tardz on Mar 10, 2020 7:02 AM
        Mark Correct
        Correct Answer
        Wow Yves, that was fast! This is exactly what I need. Only for the time scale, I would prefer to have 0 at the trigger point (i.e., the relative time).
        Thanks,
        Matjaz
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Mar 10, 2020 8:34 AM
        Mark Correct
        Correct Answer
        Have done the time correction. This the new installation file.
        Same thing that png files: open a file and push CSV files button, you will have one csv file for each bin file in the same directory.
        
        Yves
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Mar 10, 2020 4:11 PM
        Mark Correct
        Correct Answer
        I don't know if you see *.rar installation file, but this the .zip version
        
        Yves
        Attachments
        DSOC30334T with CSV files.zip278.2 KB
        Like • Show 0 Likes0
        Actions
        Matjazz @ Tardz on Mar 11, 2020 2:30 AM
        Mark Correct
        Correct Answer
        Hi Yves,
        I only see the *.zip file. The program works great converting .bin to .csv. However, now there is some problem with the .bin to .png conversion. For some reason, I cannot change the scale for the voltage (CH1) and current (CH2). They are locked to their default values. Changing the scale is very important for evaluating the data. I would be very happy if you could fix this.
        Thank you,
        Matjaz
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Mar 11, 2020 9:16 AM
        Mark Correct
        Correct Answer
        Hi,
        
        very strange, but I confirm the problem (I will verify that later today).
        About your last request, I did:
        
        thickness and color of waveform lines
        color and size of fonts for y-axis or maybe have an option to turn it off (or make the same color as background)
        color of the background
        
        I still have the number of divisions X and Y to do, maybe later today.
        
        Yves
        Like • Show 0 Likes0
        Actions
        Matjazz @ Tardz on Dec 28, 2020 6:50 AM
        Mark Correct
        Correct Answer
        Hi Yves,
        I am using your program a lot and it works great. However, I stumbled upon a problem when reading .bin files. On the oscilloscope I am recording 20 segments. From those segments, I only save one segment into the .bin file. When I try to open such file in your program, I get an error: "Cannot read file from disk. Original error: Arithmetic operation resulted in an overflow". Would it be possible to fix this? I am attaching three of such bin files.
        I have another request. Currently your program exports to CSV file only CH1 and CH2. Can you add an option in the program so I can choose which channels to export? Sometimes I need to export only the first and the second channel and sometimes all of them. The columns of CSV file should be organized in the same way: TIME, CH1(seg1), CH2(seg1), CH3(seg1), CH4(seg1), CH1(seg2), CH2(seg2), CH3(seg2), CH4(seg2), etc….
        Thanks,
        Matjaz
        Attachments
        2020-12-21-A.zip64.4 KB
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Dec 28, 2020 11:02 AM
        Mark Correct
        Correct Answer
        Hi Matt,
        I had started the program for 4 channels, but you specified that it would be for 2 channels only. So I removed the 4-channel structure from the program.
        When you say 4 channels, you also say 4 adjustable vertical axes and all the parameters that go with them. Not to mention the backups. I have to reformat the graphic space for 4 channels.
        
        I'll see what I can do with that, but right now I'm busy with some very advanced software for the Hp8505A that I'd like to finish for an evaluation.
        
        But I'll still do a quick evaluation and get back to you with an answer as soon as possible.
        
        For the files you sent me, they are two 10 segment files and one 20 segment files, and according to the headers read by the program, for 4 channels.
        
        But I would like to have one of your 1-segment files so that I can find the problem in this particular case.
        
        Yves
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Dec 28, 2020 12:36 PM
        Mark Correct
        Correct Answer
        OK Matt, I have download the last files with 1 segment, and found the error in one minute and fixed it.
        I come back to you with the evaluation for 4 channels.
        
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Dec 28, 2020 2:29 PM
        Mark Correct
        Correct Answer
        Hi Matt,
        
        After verification, the structure of the code was made for multi-channel.
        It was very simple to add the code for reading, displaying and saving as a CSV file for CH3 and CH4 (these tasks is completed).
        
        So it remains:
        - add the parameters of the traces for the 2 new channels (color, line thickness...).
        - add 2 other vertical axes for CH3 and CH4 (1 on the left side and 1 on the right side of the graticule).
        - make a resize of the graphic display to allow the addition of the 2 other vertical axes.
        - put the save options for the CSV file.
        
        I will make the changes quickly as much as possible, but please, can you confirm that I have understood your requests.
        
        Yves
        Attachments
        2020-01-09_12.csv.zip338.3 KB
        4 ch.png150.9 KB
        Like • Show 0 Likes0
        Actions
        Matjazz @ Tardz on Dec 29, 2020 12:41 AM
        Mark Correct
        Correct Answer
        Hi Yves,
        the output of the attached CSV file is exactly what I need. Is it possible to add an option to choose which channels to export? I am importing CSV data in some other program and having too much data can result in very large files. It would be great if I could export only selected channels.
        
        Regarding other things:
        - the parameters of the traces for the 2 new channels: CH3 – red and CH4 – green
        - add 2 other vertical axes for CH3 and CH4 (1 on the left side and 1 on the right side of the graticule) – That would be great, the vertical axes should be adjustable (e.g. from -1 to +6)
        - make a resize of the graphic display to allow the addition of the 2 other vertical axes. – That would be nice but having an option to display only selected channels (e.g. only CH1 and CH2 or all four of them) would be also great.
        - put the save options for the CSV file – The save option should convert all BIN files that are in the directory (the same as the program is doing now).
        
        Thank you,
        Matjaz
        Like • Show 0 Likes0
        Actions
        Tardz @ Matjazz on Dec 30, 2020 8:51 AM
        Mark Correct
        Correct Answer
        Hi Matt,
        I made all the modifications except this one: for the moment the 4 channels are displayed, I just have to put the options CH1-CH2 or CH1-CH2-CH3-CH4. For CSV files, the option to choose any of the channel combinations is operational. These are small buttons in the toolbar with the channel #: red = OFF and green = ON.
        
        I send you only the executable file, so no installation to do. Only unzip and add the extension ".exe".
        
        Final remarks:- if you change the color of a trace, the axis labels and the colors associated with the toolbar will change at the same time. On the other hand you can always modify afterwards, the color of the labels of the axes if you wish it.- The channels are displayed in the following order: CH4, CH3, CH1 and CH2 for better visibility.
        Attachments
        DSOX3034T_4ch.rar28.3 KB
        Like • Show 1 Like1
        Actions
        Tardz @ Matjazz on Dec 30, 2020 10:30 AM
        Mark Correct
        Correct Answer
        Final update. Check that, and if everything is ok, I will send you installation packaged. Add ".exe" to decompressed file.
        Attachments
        DSOX3034T_4CH.rar29.5 KB
        Like • Show 1 Like1
        Actions
        Matjazz @ Tardz on Dec 31, 2020 12:44 AM
        Mark Correct
        Correct Answer
        Amazing, everything works as I asked for. Thank you very much Yves!
        Matjaz
        Like • Show 0 Likes0
        Actions