Commit Graph

258 Commits (60a021de430ce2b410f9ede03064b1e8588e1db1)

Author SHA1 Message Date
Ryan Burns 07dc9a6687 Merge similar cuArraysCopy helpers using templates
This is to ease C++-only conversion of the cuArraysCopy kernels
by reducing code duplication
2022-10-04 16:52:19 -07:00
Zhang Yunjun 9e02af5b6e
abs module import in stackSentinel/StripMap.py (#505)
+ use absolute module import in stackSentinel.py and stackStripMap.py to allow for pythonic calls
   - e.g. stackSentinel.main() and stackStripMap.main()

+ contrib/stack/README.md: update installation note to add $ISCE_STACK to $PYTHONPATH

+ alosStack: use $ISCE_STACK/alosStack to replace $PATH_ALOSSTACK for style consistency

Co-authored-by: Zhang Yunjun <yunjunz@users.noreply.github.com>
2022-09-28 13:27:49 -07:00
Eric Fielding 1e60308201 More https changes in isceobj iscesys alos2proc
Changed other files with hard-coded SRTM or SWBD URL to https
2022-08-10 20:48:04 -07:00
Eric Fielding f73296e394 Update SWBDStitcher.py
Updated SWBDStitcher to use `https` also.
2022-08-10 12:12:20 -07:00
Eric Fielding 160487e6c0 Update DemStitcherND.py
changed to `https`
2022-08-10 12:12:20 -07:00
Eric Fielding e8c6f29636 Update DemStitcherV3.py 2022-08-10 12:12:20 -07:00
Zachary Keskinen 018f2ad842
Fix Date Parsing Bug
Previously if the directory of the downloaded files had an underscore the date would incorrectly parsed.
2022-06-19 17:41:10 -06:00
Zhang Yunjun 31bb73ba95
various bugfix for topsStack (#500)
* stackSentinel: add compute arg group and simplify main()

+ createParser(): add compute sub group for more organized print out msg

+ main():
   - remove the unsed inps.workflow value checking, as it's covered in the argparse
   - move the update stack date list checking insidie selectNeighborPairs()

* topsStack/mergeBursts: bugfix for float outY/XSize and gdal

+ mergeBursts.py: bugfix for the gdal call when outY/XSize is not integer by
   - set width/height to integer
   - add srcWin argument

+ mergeBursts.py: repeat gdal.Translate call as a workaround solution to the following gdal issue:
   - ERROR 1: Input and output dataset sizes or band counts do not match in GDALDatasetCopyWholeRaster()
   - the issue happens to version 3.3.3 and 3.4, but not in 2.3

+ unwrap: bugfix for intendation inconsistency

+ invertIon: print out num of pairs/dates

+ stackSentinel:
   - sort orbit date for downloading
   - add missing stackReferenceDate arg to selectNeighborPairs() for update mode

+ README: add link to stack processor readme for quick navigation.

* bugfix by removing existing *.hdr files

+ remove existing *.hdr files, to avoid gdal error, instead of repeat the gdal func call

+ replace the gdal_translate cmd call with gdal.Translate() in python.

+ add progress_cb() from stack overflow to printout progress bar in gdal.Translate() call
2022-06-17 11:00:13 -07:00
Zhang Yunjun 2bb3f0805d
fixImageXml: support multiple files w/ wildcards (#439)
* topsApp.xml: add downsample_snaphu

* stackSentinel: bugfix if --bbox not specified in cmd

* stack*/unwrap: print time used msg

+ print out the time used message using time.time()
+ remove unused module imports
+ indentation adjustment

* cuDenseOffsets: add --fix-image-vrt

* fixImageXml: support multiple files w/ wildcards
2022-06-10 13:19:50 -07:00
Eric Fielding 2717095323
upgraded syntax of ALOS_pre_process/readOrbitPulse.f and ISSI/src/igrf2005_sub.f to compile with new gfortran (#435)
* upgraded syntax of ALOS_pre_process/readOrbitPulse.f to compile with new gfortran

* updated subroutines in /ISSI/src/igrf2005_sub.f to be consistent
2022-02-15 16:07:32 -08:00
CunrenLiang 1eaa62a459
ionospheric phase estimation module for topsStack (#326)
* ionosphere correction for topsStack

* Update README.md

* Update Alos2ProcPublic.py

* Update Stack.py

Currently the script writes the `invertIon.py` command pointing to 'ion' and writing to 'ion_dates'. However we need the absolute paths in order to find the 'ion' directory from within the run_files directory (similar to how the `computeIon.py` function is written at l.1488)

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

Co-authored-by: Oliver Stephenson <ollie.stephenson@outlook.com>
2022-02-14 11:13:23 -08:00
Zhang Yunjun 9adf1955fc
UAVSAR_Stack: bugfix for line/sample num and dopplerFile path (#431)
* UAVSAR_Stack: bugfix for line/sample num and dopplerFile path
+ UAVSAR_Stack: use segment index while setting the number of lines / samples
+ UAVSAR_Stack: use self.dopplerFile if it exists otherwise use the path from *.ann file, to support unpackFrame_UAVSAR.py when dop file is not in the current directory
+ unpackFrame_UAVSAR: rename variables and comments to improve code readability

* use getattr() instead of hasattr()
2022-02-01 13:50:40 -08:00
Bryan Marfito c9f83bc8ed
Print that restituted or precise orbits already exists 2022-01-23 09:50:22 +08:00
Bryan Marfito 0e5114a8be
geogridOptical modules in CMakeLists.txt (#413)
* Update CMakeLists.txt
2021-12-08 14:14:36 -08:00
Ryan Burns 31803ef7fa
Merge pull request #399 from yunjunz/ampcor
cuDenseOffsets: bugfix in prepGeometry()
2021-12-07 11:34:34 -08:00
Zhang Yunjun 033e2b9cb1 cuDenseOffsets: bugfix in prepGeometry()
+ fix a bug of location shift in the input of prepGeometry()
+ add return of geomDict in estimateOffsetField() to support re-run for geometry only without --redo in cmd
+ move the redo check of cuDenseOffsets.py back the previous location, which is right before the actually running, in order to use the previous setup parameter code for geometry preparation only without re-run offset when it already exists.
+ remove size checking to be consistent with the latest version from Lijun with support of large win size
2021-11-23 22:06:27 -08:00
yunjunz 3b67950fc7 stripmapStack.createWaterMask: skip re-dload if wbd file exists 2021-11-23 22:05:49 -08:00
Lijun Zhu 5bf1eacccf PyCuAmpcor: fix scons script 2021-11-09 18:34:09 -08:00
Ryan Burns 580a9d4081 Bump autoRIFT to 1.4.0 2021-11-03 12:11:14 -07:00
Bryan Marfito 816459c954
Adjustments on CMakeLists.txt to properly install some modules (#350)
* Updated CMakeLists.txt to properly install the ISSI files thru CMake

* Update CMakeLists.txt to compile the src to generate filter.so

* Adjusted spaces on the code

* Update Stack.py
2021-09-27 19:29:51 -07:00
Bryan Marfito 6d3ca8c551
Added missing DemStitcherND.py in CMakeLists.txt
-Added missing DemStitcherND.py in CMakeLists.txt to enable downloading of NASA DEM if ISCE2 is complied through CMake.
2021-09-12 21:42:58 +08:00
Bryan Marfito d1d6b090ab
Replaced logger.warn to logger.warning, changed *.hgt* to *.hgt and updated RelaxIV download link (#332)
* Replace logger.warn to logger.warning

* Changed *.hgt* to *.hgt

* Updated link for downloading RelaxIV

* Update README.md
2021-09-09 11:05:12 -07:00
Scott Staniewicz 9f9e2e89fc
add "unpack" and "prepare" UAVSAR_HDF5 scripts for stripmap stack (#328)
* add unpack and prepare files for UAVSAR HDF5 files

* fix acq typo, expand stackStripMap to HDF5 UAVSAR

* remove comments from previous UAVSAR skeleton

* fix hard coded freq A, clarity on gdal format command
2021-09-02 12:33:19 -07:00
Ryan Burns ddcd4d85b9
Merge pull request #256 from rtburns-jpl/pycuampcor-pybind11
Convert PyCuAmpcor to pybind11
2021-09-01 11:26:38 -07:00
Bryan Marfito ad244f07b0
Proposed changes to UnwrapComp CMakeLists.txt, unwrapComponents.py and relaxIVdriver.cpp (#324)
* Updated CMakeLists.txt

* Update relaxIVdriver.cpp

* Update unwrapComponents.py

* Fix the paths on lines 445 and 446

* Fixed paths on lines 445 and 446
2021-08-31 16:36:17 -07:00
Ryan Burns d63c40a30d
Merge pull request #323 from yunjunz/tops_stack
stackSentinel: expose virtual merge via -V / --virtual_merge option
2021-08-16 15:59:37 -07:00
Ryan Burns dc96d9d39d
Merge pull request #292 from lijun99/pycuampcor
PyCuAmpcor: add support to large windows
2021-08-12 09:53:04 -07:00
ehavazli 385ed6b7d8
stage ASF data virtually for TOPS processing (#319)
* stage ASF data virtually for TOPS processing

* obsolete fetchCookies class removed
2021-08-11 12:26:13 -07:00
Zhang Yunjun 9ad03a6b77 stackSentinel.py: expose virtual merge via -V / --virtual_merge option
Add stackSentinel.py -V / --virtual_merge option to be able to change the default virtual file options. Default value is retained to not affect any existing operations.
2021-08-06 17:46:42 -07:00
Zhang Yunjun 852b3fc9ff topsStack/README: update aux_cal download cmd for the ESA link change
+ update wget cmd to update aux_cal file due to the ESA link change
+ fix typo in the dem.py command
2021-08-06 17:45:54 -07:00
Zhang Yunjun dea56dac56 topsStack: mergeBursts & s1a_isce_utils: indentation adjustment
Adjust indentations in the following scripts following pep8 style for improved readibility:
+ topsStack/mergegBursts.py
+ topsStack/s1a_isce_utils.py
2021-08-06 17:45:54 -07:00
Lijun Zhu eae30c10a8 Merge remote-tracking branch 'rtburns/pycuampcor-suggestions' into pycuampcor 2021-07-27 10:54:20 -07:00
Bryan Marfito 5297f385fd
Proposed changes to the dloadOrbits.py to reflect the new orbit file download links (#300)
I've edited the dloadOrbits.py to reflect the new orbit file download links. This may also address issue # https://github.com/isce-framework/isce2/issues/299.
2021-07-22 08:50:46 -07:00
Bryan Marfito 3928c3bdb7
Changes to relaxIVdriver.cpp to compile using the Github based RelaxIV (#288)
I've edited this code for the Github based RelaxIV (https://github.com/frangio68/Min-Cost-Flow-Class/tree/master/MCFClass)to compile properly.
2021-07-20 23:00:41 -07:00
Scott Staniewicz eb5790a884
Speed up baselineGrid.py and cut prints (#314)
* track the prev guess in `geo2rdr`, break after convergence

* create doppler Poly once, avoid prints

Orbit.geo2rdr creates a poly, which prints "Polynomial Order: 0 - by - 0" each time
2021-07-20 22:59:00 -07:00
Bryan Marfito cc4dc38638
Read unzip Sentinel-1 SLCs (#310) 2021-07-20 22:28:30 -07:00
Bryan Marfito 0fab300464
StAMPS preprocessor and stackprocessors minor modification (#309)
* Excess backslash on the slc_stack_path variable

* Removed unused imp library

* Removed unused imp library

* Removed unused imp library

* Fixed spacing on the datetime library

* Fixed spacing on the datetime library

* Removed unused imp library and fixed spacing on the datetime library

* Removed unused imp library and fixed spacing on the datetime library

* Removed unused imp library

* Removed unused imp library

* Fixed spacing on the datetime library
2021-07-20 22:16:55 -07:00
Ryan Burns a0ce9d55cb Replace cuNormalizer holder class with unique_ptr 2021-07-19 16:53:27 -07:00
Ryan Burns 14d708863d Templatize normalization routines 2021-07-19 16:34:35 -07:00
Lijun Zhu b0641ef2f5 PyCuAmpcor: add an implementation of cuCorrNormalizationSAT to support cuda 9/10 2021-07-19 15:14:04 -07:00
Lijun Zhu 80411d38aa PyCuAmpcor: add sum_area_table based correlation surface normalization to allow arbitrary window size (used to be limited by the 1024 max cuda threads) 2021-07-19 15:14:04 -07:00
Bryan Marfito e5ce2c0a29
Change the syntax to remove warning 2021-07-02 11:42:39 +08:00
Ryan Burns a976d12c51
Merge pull request #276 from yunjunz/offset
cuDenseOffsets.prep*Geom*: supp. full-reso file w/o .full in the name
2021-06-14 15:48:21 -07:00
Ryan Burns 038c04d5b9
Merge pull request #285 from rtburns-jpl/python39
Remove use of deprecated XML ElementTree getchildren method
2021-05-28 11:40:36 -07:00
Bryan Marfito ef29fecb92
Proposed fix on a bug in create_cmds.py (#291)
I'm proposing a fix to create_cmds.py since I found a minor bug in line 165 which doesn't remove the excluded dates during image stacking. Instead line 165 removes dates based on the dates not included from the dates to be included parameter on the alosStack.xml.

The image folder contains the ALOS-2 images with dates 191005, 191019, 191102, 191214, 191228.

I've tested the changes and it worked properly.

Co-authored-by: Ryan Burns <rtburns@jpl.nasa.gov>
2021-05-27 18:33:52 -07:00
Ryan Burns bbf8cb55ae
Merge pull request #279 from RussellGrew/flip_latlon
Swap lat/lon for proj6 and gdal3.
2021-05-27 13:30:11 -07:00
Ryan Burns 673dc04fcb
Merge pull request #272 from lijun99/cuda_fix
cuda Scons fix: remove unnecessary -lcuda which prevents compiling on…
2021-05-17 12:06:19 -07:00
Ryan Burns a540c0116e Remove use of deprecated XML ElementTree getchildren method 2021-05-13 10:59:16 -07:00
Lijun Zhu e24b501b5b PyCuAmpcor: add an implementation of cuCorrNormalizationSAT to support cuda 9/10 2021-05-11 15:32:47 -07:00
Russell Grew 21084da4df
Robust GDAL version check
Co-authored-by: Ryan Burns <rtburns@jpl.nasa.gov>
2021-05-11 16:00:12 +10:00