Skip to content

Measurement Set metadata summary, and terminal histograms for flag tables

Notifications You must be signed in to change notification settings

IanHeywood/ms_info

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

50 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ms_info.py

Examine a Measurement Set and print some basic information to the terminal. This is kind of like a standalone version of CASA's listobs task.

Usage: ms_info.py [options] msname

Options:
  -h, --help  show this help message and exit
  --nofield   Do not list FIELD information
  --noscan    Do not list SCAN information
  --nospw     Do not list SPECTRAL_WINDOW information
  --noant     Do not list ANTENNA information

Example output:

Reading: 15A-310.sb30701840.eb31080533.57264.008705092594.ms

     Track length:             10766.0s (2.99 h)
     Mean integration time:    2.0 s

---- FIELDS:

     ROW   ID    NAME                RA              DEC
     0     0     SGRA                17h45m40.0383s  -29d00m28.069s  
     1     1     J1714-2514          17h14m47.857s   -25d14m35.144s  
     2     2     1411+522=3C295      14h11m20.6477s  +52d12m09.141s  

---- SCANS:

     Total time for field 0 is 9320.0 s (2.59 h)
     Total time for field 1 is 944.0 s (0.26 h)
     Total time for field 2 is 410.0 s (0.11 h)

     SCAN  FIELD_ID      LENGTH[s]     INTEGRATIONS
     1     0             594.0         297           
     2     0             56.0          28            
     3     1             160.0         80            
     4     0             576.0         288           
     5     0             578.0         289           
     6     0             580.0         290           
     7     1             160.0         80            
     8     0             576.0         288           
     9     0             578.0         289           
     10    0             580.0         290           
     11    1             160.0         80            
     12    0             574.0         287           
     13    0             580.0         290           
     14    0             580.0         290           
     15    1             160.0         80            
     16    0             574.0         287           
     17    0             580.0         290           
     18    0             580.0         290           
     19    1             160.0         80            
     20    0             574.0         287           
     21    0             580.0         290           
     22    0             580.0         290           
     23    1             144.0         72            
     24    2             410.0         205           

---- SPECTRAL WINDOWS:

     ROW   CHANS         WIDTH[MHz]    REF_FREQ[MHz]
     0     64            2.0           7988.0        
     1     64            2.0           8116.0        
     2     64            2.0           8244.0        
     3     64            2.0           8372.0        
     4     64            2.0           8500.0        
     5     64            2.0           8628.0        
     6     64            2.0           8756.0        
     7     64            2.0           8884.0        
     8     64            2.0           8988.0        
     9     64            2.0           9116.0        
     10    64            2.0           9244.0        
     11    64            2.0           9372.0        
     12    64            2.0           9500.0        
     13    64            2.0           9628.0        
     14    64            2.0           9756.0        
     15    64            2.0           9884.0        
     16    128           0.125         224.0         
     17    128           0.125         240.0         
     18    128           0.125         256.0         
     19    128           0.125         272.0         
     20    128           0.125         288.0         
     21    128           0.125         304.0         
     22    128           0.125         320.0         
     23    128           0.125         336.0         
     24    128           0.125         352.0         
     25    128           0.125         368.0         
     26    128           0.125         384.0         
     27    128           0.125         400.0         
     28    128           0.125         416.0         
     29    128           0.125         432.0         
     30    128           0.125         448.0         
     31    128           0.125         464.0         

---- ANTENNAS:

     27 / 27 antennas in the main table

     ROW   NAME          POSITION
     0     ea01          [-1599855.687  -5033332.3686  3567636.6138]
     1     ea02          [-1601061.9576 -5041175.8814  3556058.0331]
     2     ea03          [-1610451.9328 -5042471.1238  3550021.0558]
     3     ea04          [-1595124.9371 -5045829.4762  3552210.6836]
     4     ea05          [-1584460.8832 -5052385.6148  3547600.0411]
     5     ea06          [-1600592.749  -5038121.3413  3560574.8462]
     6     ea07          [-1599557.9287 -5031396.3534  3570494.7434]
     7     ea08          [-1587600.1922 -5050575.8707  3548885.4139]
     8     ea09          [-1601614.0912 -5042001.6569  3554652.5143]
     9     ea10          [-1597053.1184 -5044604.6922  3553059.0111]
     10    ea11          [-1604008.7471 -5042135.8051  3553403.7163]
     11    ea12          [-1600781.0441 -5039347.437   3558761.5433]
     12    ea13          [-1602592.8535 -5042054.9891  3554140.713 ]
     13    ea14          [-1600801.9314 -5042219.3817  3554706.4312]
     14    ea15          [-1598663.0943 -5043581.3811  3553767.012 ]
     15    ea16          [-1616361.5755 -5042770.5166  3546911.4199]
     16    ea17          [-1600930.0729 -5040316.3849  3557330.4072]
     17    ea18          [-1619757.2999 -5042937.6564  3545120.3923]
     18    ea19          [-1607962.4518 -5042338.2041  3551324.9455]
     19    ea20          [-1600374.881  -5036704.2175  3562667.8939]
     20    ea21          [-1590380.599  -5048810.2613  3550108.4443]
     21    ea22          [-1605808.6341 -5042230.084   3552459.2011]
     22    ea23          [-1599926.1061 -5042772.9644  3554319.7876]
     23    ea25          [-1613255.3914 -5042613.0978  3548545.906 ]
     24    ea26          [-1592894.0776 -5047229.1182  3551221.221 ]
     25    ea27          [-1601147.9397 -5041733.8204  3555235.9566]
     26    ea28          [-1600128.4025 -5035104.1392  3565024.6704]

ms_flags.py

Determines percentage of data flagged per antenna and per frequency chunk, and prints a histogram in the terminal.

Usage: ms_flags.py [options] msname

Options:
  -h, --help          show this help message and exit
  --field=FIELD       Select field ID (default = 0)
  --corr=CORR         Select correlation product to use (default = 0)
  --scan=SCAN         Select only a specific scan number (default = all scans)
  --noants            Do not show per-antenna flags percentages
  --noband            Do not show frequency chunk percentages
  --chunk=CHAN_CHUNK  Number of channels to average per frequency bin (default
                      = 32)
  --o=OP_PICKLE       Name of flag stats pickle (default = flag_stats.p,
                      inside MS)
  --f                 Force overwrite of existing flag stats pickle

Example output:

Getting per-antenna flag stats, please wait.
First antenna took 6.21 seconds, 60 to go.
Estimated completion at 23:23:07.
Done

Flagged percentages per antenna:

                  0%       20%       40%       60%       80%       100%
                  |         |         |         |         |         |
 m000      100.0%  ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m001      51.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m002      47.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m003      48.1%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m004      50.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m005      47.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m006      48.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m007      48.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m008      47.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m009      50.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m010      47.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m011      100.0%  ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m012      50.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m013      50.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m014      48.1%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m015      51.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m016      49.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m017      49.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m018      53.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m019      50.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m021      47.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m022      47.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m023      53.5%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m024      47.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m025      47.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m026      49.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m027      50.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m028      48.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m029      50.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m030      49.1%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m031      53.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m032      50.3%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m033      48.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m034      48.1%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m036      50.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m037      49.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m038      54.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m039      50.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m040      50.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m041      49.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m043      49.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m044      49.3%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m045      46.3%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m046      46.5%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m047      50.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m048      46.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m049      46.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m050      46.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m051      46.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m052      46.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m053      46.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m054      46.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m055      46.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m056      45.8%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m057      45.5%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m058      45.1%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m059      44.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m060      44.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m061      45.5%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m062      45.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 m063      45.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎


Flagged percentages across the band:

                  0%       20%       40%       60%       80%       100%
                  |         |         |         |         |         |
 0-31      47.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 32-63     19.0%   ∎∎∎∎∎∎∎∎∎
 64-95     47.5%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 96-127    93.5%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 128-159   19.0%   ∎∎∎∎∎∎∎∎∎
 160-191   18.3%   ∎∎∎∎∎∎∎∎∎
 192-223   22.9%   ∎∎∎∎∎∎∎∎∎∎∎
 224-255   18.7%   ∎∎∎∎∎∎∎∎∎
 256-287   29.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 288-319   27.4%   ∎∎∎∎∎∎∎∎∎∎∎∎∎
 320-351   38.3%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 352-383   99.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 384-415   99.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 416-447   99.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 448-479   98.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 480-511   99.1%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 512-543   74.6%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 544-575   17.7%   ∎∎∎∎∎∎∎∎
 576-607   18.4%   ∎∎∎∎∎∎∎∎∎
 608-639   19.0%   ∎∎∎∎∎∎∎∎∎
 640-671   18.9%   ∎∎∎∎∎∎∎∎∎
 672-703   17.9%   ∎∎∎∎∎∎∎∎
 704-735   17.7%   ∎∎∎∎∎∎∎∎
 736-767   19.0%   ∎∎∎∎∎∎∎∎∎
 768-799   34.7%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 800-831   99.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 832-863   99.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 864-895   99.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 896-927   50.2%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 928-959   17.8%   ∎∎∎∎∎∎∎∎
 960-991   44.9%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎
 992-1023  86.0%   ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎

About

Measurement Set metadata summary, and terminal histograms for flag tables

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages