Commit Graph

67 Commits (4f045449ab2cc90dd45aff5ca6df85df0c989c59)

Author SHA1 Message Date
Zachary Keskinen 018f2ad842
Fix Date Parsing Bug
Previously if the directory of the downloaded files had an underscore the date would incorrectly parsed.
2022-06-19 17:41:10 -06:00
Zhang Yunjun 2bb3f0805d
fixImageXml: support multiple files w/ wildcards (#439)
* topsApp.xml: add downsample_snaphu

* stackSentinel: bugfix if --bbox not specified in cmd

* stack*/unwrap: print time used msg

+ print out the time used message using time.time()
+ remove unused module imports
+ indentation adjustment

* cuDenseOffsets: add --fix-image-vrt

* fixImageXml: support multiple files w/ wildcards
2022-06-10 13:19:50 -07:00
Zhang Yunjun 9adf1955fc
UAVSAR_Stack: bugfix for line/sample num and dopplerFile path (#431)
* UAVSAR_Stack: bugfix for line/sample num and dopplerFile path
+ UAVSAR_Stack: use segment index while setting the number of lines / samples
+ UAVSAR_Stack: use self.dopplerFile if it exists otherwise use the path from *.ann file, to support unpackFrame_UAVSAR.py when dop file is not in the current directory
+ unpackFrame_UAVSAR: rename variables and comments to improve code readability

* use getattr() instead of hasattr()
2022-02-01 13:50:40 -08:00
yunjunz 3b67950fc7 stripmapStack.createWaterMask: skip re-dload if wbd file exists 2021-11-23 22:05:49 -08:00
Scott Staniewicz 9f9e2e89fc
add "unpack" and "prepare" UAVSAR_HDF5 scripts for stripmap stack (#328)
* add unpack and prepare files for UAVSAR HDF5 files

* fix acq typo, expand stackStripMap to HDF5 UAVSAR

* remove comments from previous UAVSAR skeleton

* fix hard coded freq A, clarity on gdal format command
2021-09-02 12:33:19 -07:00
Scott Staniewicz eb5790a884
Speed up baselineGrid.py and cut prints (#314)
* track the prev guess in `geo2rdr`, break after convergence

* create doppler Poly once, avoid prints

Orbit.geo2rdr creates a poly, which prints "Polynomial Order: 0 - by - 0" each time
2021-07-20 22:59:00 -07:00
Bryan Marfito 0fab300464
StAMPS preprocessor and stackprocessors minor modification (#309)
* Excess backslash on the slc_stack_path variable

* Removed unused imp library

* Removed unused imp library

* Removed unused imp library

* Fixed spacing on the datetime library

* Fixed spacing on the datetime library

* Removed unused imp library and fixed spacing on the datetime library

* Removed unused imp library and fixed spacing on the datetime library

* Removed unused imp library

* Removed unused imp library

* Fixed spacing on the datetime library
2021-07-20 22:16:55 -07:00
Ryan Burns a976d12c51
Merge pull request #276 from yunjunz/offset
cuDenseOffsets.prep*Geom*: supp. full-reso file w/o .full in the name
2021-06-14 15:48:21 -07:00
Ryan Burns a540c0116e Remove use of deprecated XML ElementTree getchildren method 2021-05-13 10:59:16 -07:00
yunjunz ef88f247e2 stackStripMap: bugfix when --sensor is not specified 2021-04-23 16:31:49 -07:00
Zhang Yunjun e712ca358c stackStripMap: indentation adjusts
following PEP008
2021-04-23 16:31:49 -07:00
Sara Mirzaee 68c7261b5d
Stack minor modification (#232)
* stackStripMap.py: change numbering style to match with topsStack

* Stack.py: separate parallel processors in topo.py from runfiles

* stackSentinel.py: add a new argument for parallel processors in topo.py

* Stack.py: remove extra num_process for unpackStackReferenceSLC

* stackSentinel.py:  tie numProcess4topo to numProcessif the first not specified
2021-02-15 11:24:56 -08:00
Ryan Burns ad1815ef9c Modernize gdal imports
GDAL has dropped support for the older toplevel `import gdal`
in version 3.2, now requiring `from osgeo import gdal`.
2021-01-06 13:24:26 -08:00
Eric Fielding c601204942
Added code to stripmapStack/topo.py to work with newer GDAL (#196)
* added option to pass segment number through unpackFrame_UAVSAR

* changed type of segment number

* changed segment type in prepareUAVSAR_coregstack

* Revert "changed type of segment number"

This reverts commit a18c6452d4b5c95ce869dab2ee1e3bcf6ff2b1d9.

* Revert "changed segment type in prepareUAVSAR_coregstack"

This reverts commit 6cf3ebadb3a6e119c6084c8e03b8cc68d7eccc3f.

* changed type of segment number in unpackFrame_UAVSAR

* Added code to stripmapStack/topo.py to explicitly create the `geom_reference/hgt.rdr.vrt` file to work with newer GDAL
2020-10-24 09:36:08 -07:00
Eric Fielding 6aa2d065c3
added option to pass segment number through unpackFrame_UAVSAR (#171)
* added option to pass segment number through unpackFrame_UAVSAR

* changed type of segment number

* changed segment type in prepareUAVSAR_coregstack

* Revert "changed type of segment number"

This reverts commit a18c6452d4b5c95ce869dab2ee1e3bcf6ff2b1d9.

* Revert "changed segment type in prepareUAVSAR_coregstack"

This reverts commit 6cf3ebadb3a6e119c6084c8e03b8cc68d7eccc3f.

* changed type of segment number in unpackFrame_UAVSAR
2020-10-04 16:30:18 -07:00
piyushrpt 5370690b0a Pulling in PR #153 2020-10-04 11:10:24 -07:00
Zhang Yunjun f14981341d update system call of gdal2isce_xml with python interface
+ update os.system() call of gdal2isce_xml.py with the python function call, in stripmapStack/topo.py and applications/downsampleDEM.py

+ break the long lines in downsampleDEM.py for easy reading
2020-09-12 17:05:33 -07:00
Heresh Fattahi eb3eff61a6
Merge branch 'master' into BLM 2020-07-02 15:03:10 -07:00
Paul A Rosen e03042f4e5 diversity: replaced oppressive language with neutral definitions of the images that comprise an interferogram through the entire repository 2020-07-02 12:40:49 -07:00
Zhang Yunjun 90d578fa5d cuDenseOffsets: expose --raw-osf and --corr-win-size option
contrib/PyCuAmpcor/cuDenseOffsets.py:
+ expose --raw-over-samp-factor option to change the raw data oversampling factor with default of 2
+ expose --corr-win-size option, which by default, is calculated automatically based on the search window size and raw oversampling factor
+ change the namespace key for the oversampling factor of correlation surface from 'oversample' to 'corr_oversample' to avoid ambiguity, the cmd option name is still the same, thus no different in the user side.
+ use vrt file for master / slave slc data loading folllowing https://github.com/isce-framework/isce2/pull/78
+ re-organize createParse() for readability
+ add example to argparse help

stripmapStack/MaskAndFilter.py:
+ fix a bug introduced in #https://github.com/isce-framework/isce2/pull/112
+ add example usage to help message
+ mask pixels with SNR == 0, for plotting only without touching data files
+ show input parameter in the figure title
+ show percentage after SNR thresholding
+ add interpolation for matplotlib while plotting

topsStack/grossOffsets: move obsolete basemap import from the top to the related commented code block
2020-06-28 19:24:09 -07:00
Zhang Yunjun 35a80f0a5f bugfix in stripmapStack/Stack for config unwIfg if filter is turned off
If filter is turned OFF while unwrapping is still ON, the phase unwrapping output filename should not include "filt_" prefix.
2020-05-17 14:58:39 -07:00
Zhang Yunjun 4282bb8e0a prepSlcALOS2: add --polarization to pass to unpackFrame* 2020-05-03 14:12:24 -07:00
Zhang Yunjun 6a78c4e6d6 skip filtering if --filter_strength <= 0
+ FilterAndCoherence: skip filtering if input filter strength <= 0 and use original phase for coherence estimation

+ Stack: do not add filt_ prefix to output file if input filter strength <= 0
2020-05-03 14:12:24 -07:00
Zhang Yunjun d494ae3924 Stack: adjust indentation 2020-05-03 14:12:24 -07:00
Zhang Yunjun 34fb0b66fa Stack: skip PU if input method is "no" 2020-05-03 14:12:24 -07:00
Zhang Yunjun d41ffb0ce9 stackStripMap: suppress matplotlib DEBUG msg 2020-05-03 14:12:24 -07:00
Zhang Yunjun 8017039ecb topo: replace gdal_translate cmd call with gda.Translate()
+ add more print out message
2020-05-02 11:54:17 -07:00
Zhang Yunjun 08dfd9de21 topo: call gdal2isce_xml.py inside runMultilook() if xml file missing
+ topo: merge runMultilookGdal() into runMultilook() with new argument "method" to control to use isce Looks module (averaging) or gdal_translate (extraction; default, same as before).

+ topo: call gdal2isce_xml.py so that xml file for multilooked data are always generate. This fix the warning message from gdal_translate: "Warning 1: Geotransform matrix has non rotational terms"

+ topo: skip multilooking if the data file has vrt/xml file missing, which sometimes happens to incLocal and shadowMask (don't know the cause yet; I used GPU version).

+ crossmul/resampleSlc: re-organize module import at the top of scripts
2020-05-02 10:26:29 -07:00
Ryan Burns 23f2ffaa1e
Use exist_ok argument to makedirs when appropriate (#112)
@falkamelung noted a race condition in #106 due to non-atomic directory
checking followed by os.makedirs. This pattern exists in many places
in the codebase so I went ahead and replaced the rest of them.
The new exist_ok usage should be terser and more idiomatic.
2020-04-13 12:40:32 -07:00
Zhang Yunjun 17b22417fd topo: add more arguments for runMultilookGdal()
+ add in_ext/out_ext/fbase_list for more flexibility

+ fix bug for .full.xml file copying when input/output are in the same directory
2020-03-23 17:09:04 -07:00
Zhang Yunjun b0cecb64cb createWaterMask: add --fill option
+ add --fill option to be able to change the fill value for the missing water body data, because sometimes it's land sometimes it's water.
2020-03-23 17:07:48 -07:00
Zhang Yunjun 7644bf8c93 MaskAndFilter: more ploting options
+ plot the evolution of offset after each step to better check the changes by masking, filling and filtering operations.

+ plot both azimuth and range offset in one figure and move the plotting to the end after file writing

+ update file path in xml file so that script can work even if the files are moved.

+ convert SNR nan value to zero before used as the mask, to avoid warning message

+ add the following options to customize the plot
   - add -v and --v-snr option to change the display range for offset and SNR
   - add --figsize and --save option

+ suppress the DEBUG message from matplotlib

+ remove obsolete getShape() and resampleOffset()

+ update IML module import

+ adjust indentation
2020-03-23 17:04:08 -07:00
Zhang Yunjun 82b46df741 dem.py: use abspath filename in xml after correction
+ dem.py: replace filename in xml file with abspath after geoid to ellipsoid correction

+ update README.md files in contrib/stack/*Stack, as fixImageXml.py is not needed anymore

+ fixImageXml: use native argparse mutually exclusive group for --full/--base options to replace checking with own code
2020-03-19 14:11:16 -07:00
Heresh Fattahi 4998f720d7
Merge pull request #39 from EJFielding/UAVSAR
added back command line option in prepareUAVSAR
2020-03-13 08:27:52 -07:00
Ryan Burns 35ca7db85e Fix trackCRs script
* Strip leading zero from LLH list
* Cast slice bounds to ints
* Use comma delimiter for reading CSVs
2020-01-22 10:07:18 -08:00
Eric J. Fielding db51787372 Merge branch 'master' of https://github.com/isce-framework/isce2 into UAVSAR 2020-01-07 14:51:56 -08:00
Zhang Yunjun 1b70f52f91 stripmapStack: convert README.txt to README.md
+ convert README.txt to README.md

+ stackStripMap.py: group iono options in createParser()
   - group all iono options in createParser() for more easily navigation in --help.

   - fix typos in the descriptions for the script and --dem option.
2020-01-05 18:46:00 -08:00
Zhang Yunjun ad51158a44 stripmapStack: add function createWaterMask to config_master_*
Stack.py: add function call to create water mask file in radar coordinates in the step one "run_1_master_*"

createWaterMask.py: fill pixels without DEM data with value of -1, same as water body
2020-01-03 16:45:59 -08:00
Zhang Yunjun b2f3204595 stripmapStack/createWaterMask: add --dem_file opt
add -d / --dem_file option to input DEM file as an alternative for --bbox option.

add dem2bbox() to grab bbox from existing DEM file

adjust download_waterMask() that: if DEM file is input, put downloaded water body mask file to the same directory as the DEM file.

adjust the default water mask file in radar coordinates that:
1. in the same directory as the input lat/lon files
2. named as "waterMask.rdr" instead of "swbdLat_*.wbd.rdr"

add example docstring and update parser description.
2020-01-03 16:45:59 -08:00
Zhang Yunjun 18bd583ec2 topo: multilook geometry file with gdal_translate 2019-12-24 16:29:40 -08:00
Zhang Yunjun 6061697fb9 stripmapStack: generate multilooked geometry files
Stack:
+ add alks and rlks options in config.topo()

topo: if number of looks is larger than 1, generate multilooked geometry files
+ generate `geom_master` folder in the root directory, same level as `Igrams`
+ import mroipac.looks.Looks module to multilook the full resolution geometry files from `./merged/geom_master`
+ copy over the full resolution xml/vrt files from `./merged/geome` to `./geom_master` as `*.full.xml/vrt` files, to support the number of looks extraction for mintpy
+ bug fixed in extractInfo(). This was not a problem before because the default values are 1 and the custom values from argument was not inputed in the config file.
2019-12-18 17:00:38 -08:00
Eric J. Fielding baf2ae6e35 Merge branch 'master' of https://github.com/isce-framework/isce2 into UAVSAR 2019-12-17 18:08:13 -08:00
Eric J. Fielding 36e7012e66 Merge branch 'master' of https://github.com/isce-framework/isce2 into UAVSAR 2019-12-03 16:41:41 -08:00
Zhang Yunjun 43aee1dcb3 stripmapStack/unwrap: adjust indentation 2019-11-21 13:35:21 -08:00
Zhang Yunjun 6e36a73fb0 stripmapStack/unwrap: enable corrlooks for SNAPHU
Stack:
+ add alks and rlks while writing config file for unwrap

unwrap:
+ calculate the az/rg spacing/resolution and the equivalent number of independent looks in extractInfoFromPickle()
+ uncomment corrlooks setting in runUnwrap()
2019-11-21 10:58:28 -08:00
stoormgeo cf8b47935d stripmapStack. Changing indentations in the baselinerGrid.py
Changes to be committed:
	modified:   baselineGrid.py
2019-10-04 14:56:56 +03:00
Microwave Remote Sensing Laboratory 620ea91641
Add files via upload 2019-09-26 15:22:27 -04:00
Eric J. Fielding 63887754f0 Merge branch 'master' of https://github.com/isce-framework/isce2 into UAVSAR 2019-07-22 17:49:50 -07:00
piyushrpt 8345318434 Fix for importlib has no attribute util 2019-07-19 01:15:10 -07:00
Eric Jameson Fielding 919ce84b9b Modified the contrib/stack/stripmapStack/Stack.py code to write out baseline files with baselines set to 0.0 instead of skipping them. 2019-05-22 15:26:13 -07:00