Commit Graph

92 Commits (31bb73ba9511c746512b49fb2b89d62aa6e7154f)

Author SHA1 Message Date
Zhang Yunjun 31bb73ba95
various bugfix for topsStack (#500)
* stackSentinel: add compute arg group and simplify main()

+ createParser(): add compute sub group for more organized print out msg

+ main():
   - remove the unsed inps.workflow value checking, as it's covered in the argparse
   - move the update stack date list checking insidie selectNeighborPairs()

* topsStack/mergeBursts: bugfix for float outY/XSize and gdal

+ mergeBursts.py: bugfix for the gdal call when outY/XSize is not integer by
   - set width/height to integer
   - add srcWin argument

+ mergeBursts.py: repeat gdal.Translate call as a workaround solution to the following gdal issue:
   - ERROR 1: Input and output dataset sizes or band counts do not match in GDALDatasetCopyWholeRaster()
   - the issue happens to version 3.3.3 and 3.4, but not in 2.3

+ unwrap: bugfix for intendation inconsistency

+ invertIon: print out num of pairs/dates

+ stackSentinel:
   - sort orbit date for downloading
   - add missing stackReferenceDate arg to selectNeighborPairs() for update mode

+ README: add link to stack processor readme for quick navigation.

* bugfix by removing existing *.hdr files

+ remove existing *.hdr files, to avoid gdal error, instead of repeat the gdal func call

+ replace the gdal_translate cmd call with gdal.Translate() in python.

+ add progress_cb() from stack overflow to printout progress bar in gdal.Translate() call
2022-06-17 11:00:13 -07:00
Zhang Yunjun 2bb3f0805d
fixImageXml: support multiple files w/ wildcards (#439)
* topsApp.xml: add downsample_snaphu

* stackSentinel: bugfix if --bbox not specified in cmd

* stack*/unwrap: print time used msg

+ print out the time used message using time.time()
+ remove unused module imports
+ indentation adjustment

* cuDenseOffsets: add --fix-image-vrt

* fixImageXml: support multiple files w/ wildcards
2022-06-10 13:19:50 -07:00
CunrenLiang 1eaa62a459
ionospheric phase estimation module for topsStack (#326)
* ionosphere correction for topsStack

* Update README.md

* Update Alos2ProcPublic.py

* Update Stack.py

Currently the script writes the `invertIon.py` command pointing to 'ion' and writing to 'ion_dates'. However we need the absolute paths in order to find the 'ion' directory from within the run_files directory (similar to how the `computeIon.py` function is written at l.1488)

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

Co-authored-by: Oliver Stephenson <ollie.stephenson@outlook.com>
2022-02-14 11:13:23 -08:00
Bryan Marfito c9f83bc8ed
Print that restituted or precise orbits already exists 2022-01-23 09:50:22 +08:00
Bryan Marfito 816459c954
Adjustments on CMakeLists.txt to properly install some modules (#350)
* Updated CMakeLists.txt to properly install the ISSI files thru CMake

* Update CMakeLists.txt to compile the src to generate filter.so

* Adjusted spaces on the code

* Update Stack.py
2021-09-27 19:29:51 -07:00
Ryan Burns d63c40a30d
Merge pull request #323 from yunjunz/tops_stack
stackSentinel: expose virtual merge via -V / --virtual_merge option
2021-08-16 15:59:37 -07:00
ehavazli 385ed6b7d8
stage ASF data virtually for TOPS processing (#319)
* stage ASF data virtually for TOPS processing

* obsolete fetchCookies class removed
2021-08-11 12:26:13 -07:00
Zhang Yunjun 9ad03a6b77 stackSentinel.py: expose virtual merge via -V / --virtual_merge option
Add stackSentinel.py -V / --virtual_merge option to be able to change the default virtual file options. Default value is retained to not affect any existing operations.
2021-08-06 17:46:42 -07:00
Zhang Yunjun 852b3fc9ff topsStack/README: update aux_cal download cmd for the ESA link change
+ update wget cmd to update aux_cal file due to the ESA link change
+ fix typo in the dem.py command
2021-08-06 17:45:54 -07:00
Zhang Yunjun dea56dac56 topsStack: mergeBursts & s1a_isce_utils: indentation adjustment
Adjust indentations in the following scripts following pep8 style for improved readibility:
+ topsStack/mergegBursts.py
+ topsStack/s1a_isce_utils.py
2021-08-06 17:45:54 -07:00
Bryan Marfito 5297f385fd
Proposed changes to the dloadOrbits.py to reflect the new orbit file download links (#300)
I've edited the dloadOrbits.py to reflect the new orbit file download links. This may also address issue # https://github.com/isce-framework/isce2/issues/299.
2021-07-22 08:50:46 -07:00
Bryan Marfito cc4dc38638
Read unzip Sentinel-1 SLCs (#310) 2021-07-20 22:28:30 -07:00
Bryan Marfito 0fab300464
StAMPS preprocessor and stackprocessors minor modification (#309)
* Excess backslash on the slc_stack_path variable

* Removed unused imp library

* Removed unused imp library

* Removed unused imp library

* Fixed spacing on the datetime library

* Fixed spacing on the datetime library

* Removed unused imp library and fixed spacing on the datetime library

* Removed unused imp library and fixed spacing on the datetime library

* Removed unused imp library

* Removed unused imp library

* Fixed spacing on the datetime library
2021-07-20 22:16:55 -07:00
Bryan Marfito e5ce2c0a29
Change the syntax to remove warning 2021-07-02 11:42:39 +08:00
Ryan Burns bbf8cb55ae
Merge pull request #279 from RussellGrew/flip_latlon
Swap lat/lon for proj6 and gdal3.
2021-05-27 13:30:11 -07:00
Russell Grew 21084da4df
Robust GDAL version check
Co-authored-by: Ryan Burns <rtburns@jpl.nasa.gov>
2021-05-11 16:00:12 +10:00
Bryan Marfito f48e71d138
Changes to line 155 of fetchOrbit.py
I've made some changes to fetchOrbit.py due to changes made by ESA based on the issue presented in https://github.com/isce-framework/isce2/pull/273#issuecomment-833967310.
2021-05-07 15:57:36 +08:00
Russell Grew 8ba8f32f67 gdal version smarts for lat/lon order 2021-05-07 08:39:13 +10:00
Bryan Marfito 2f8de43d28
Changes on the fetchOrbit.py to download orbit files from the new ESA website (#273)
* Changes to fetchOrbit.py to download orbit files in the new ESA website

I've made changes to the fetchOrbit.py to download the files on the https://scihub.copernicus.eu/gnss/#/home. I've used the generic credentials to query and download the orbit files.

* Update fetchOrbit.py

* Make output path generic

I've used os.path.join on line no. 165 to make it more generic.

* Set the verify option to true

I've set the verify option to True to remove the warning regarding "Unverified HTTPS request".

* Changes to the download link of the fetchOrbit.py

The download link before uses the href link on the XML of the website. It was properly working right until yesterday when it didn't work properly.  

Instead I've edited the script to be consistent instead with the download link on the scihub copernicus GNSS website. I've tested it and it worked properly.

* Update fetchOrbit.py
2021-05-03 22:06:54 -07:00
Russell Grew e499aec055 Swap lat/lon for proj6 and gdal3. 2021-05-03 13:03:11 +10:00
Bryan Marfito f3d38d4135
Update fetchOrbit.py 2021-03-25 08:16:42 +08:00
Bryan Marfito 41721e3d1d
Update fetchOrbit.py 2021-03-25 06:32:37 +08:00
Bryan Marfito b5c1c6420a
Update fetchOrbit.py 2021-03-24 14:14:33 +08:00
Bryan Marfito 32b4ac58be
Update contrib/stack/topsStack/fetchOrbit.py
Co-authored-by: Ryan Burns <rtburns@jpl.nasa.gov>
2021-03-24 14:13:54 +08:00
Bryan Marfito ced1938472
Update fetchOrbit.py 2021-03-24 09:57:20 +08:00
Bryan Marfito 92ecd7d5ed
Update fetchOrbit.py 2021-03-24 09:57:01 +08:00
Bryan Marfito f67a4cfbaa
Update fetchOrbit.py 2021-03-24 09:48:09 +08:00
Bryan Marfito a10cba9f93
Update fetchOrbit.py 2021-03-24 08:07:19 +08:00
Bryan Marfito 3499b3f09b
Update fetchOrbit.py 2021-03-24 06:21:44 +08:00
Bryan Marfito f1187fd935
Update contrib/stack/topsStack/fetchOrbit.py
Co-authored-by: Ryan Burns <rtburns@jpl.nasa.gov>
2021-03-24 06:21:03 +08:00
Bryan Marfito 7c9f061f59
Update fetchOrbit.py 2021-03-23 19:01:01 +08:00
Bryan Marfito 415a89365c
Update fetchOrbit.py 2021-03-21 20:13:15 +08:00
Bryan Marfito ad2729be00
Update fetchOrbit.py 2021-03-21 20:12:24 +08:00
Bryan Marfito a8e3e2c175
Update fetchOrbit.py 2021-03-17 22:04:13 +08:00
Bryan Marfito 198b23aa3f
Update fetchOrbit.py 2021-03-17 22:00:21 +08:00
Bryan Marfito e5e0a4560d
Update fetchOrbit.py 2021-03-17 21:36:43 +08:00
Bryan Marfito a4cf6f5b58
Update fetchOrbit.py 2021-03-17 21:20:52 +08:00
Bryan Marfito 83f363d0c5
Update fetchOrbit.py 2021-03-14 21:29:13 +08:00
Bryan Marfito c8af76be10
Update fetchOrbit.py 2021-03-14 21:11:21 +08:00
Bryan Marfito a25f80537a
Proposed changes to the fetchOrbit.py
After running the currently modified fetchOrbits.py, I've found out that the downloaded precise orbits were based on the date that they were processed instead of the date that they can be used. I've also modified the code to prevent downloading of restituted orbit if the precise orbit is available.

Pls. check if the changes I've made applies the orbit files to the Sentinel-1 SLC images properly.
2021-03-12 23:36:45 +08:00
Sara Mirzaee 1a86bca5c4 fix url change 2021-03-09 13:43:13 -06:00
Sara Mirzaee e40f70593f
Update README.md
qc.sentinel1.eo.esa.int -> aux.sentinel1.eo.esa.int
2021-03-09 09:57:24 -05:00
Sara Mirzaee 500b9e2de2 dloadOrbits.py: fix url change 2021-03-09 08:24:02 -06:00
Ryan Burns b60e87d063
Merge pull request #236 from lijun99/pycuampcor
Updates to PyCuAmpcor
2021-02-19 10:27:38 -08:00
Sara Mirzaee 68c7261b5d
Stack minor modification (#232)
* stackStripMap.py: change numbering style to match with topsStack

* Stack.py: separate parallel processors in topo.py from runfiles

* stackSentinel.py: add a new argument for parallel processors in topo.py

* Stack.py: remove extra num_process for unpackStackReferenceSLC

* stackSentinel.py:  tie numProcess4topo to numProcessif the first not specified
2021-02-15 11:24:56 -08:00
Lijun Zhu 86a35acd5e merge mzzhong/grossOffsets into pycuampcor: scripts to set varying offsets withe velocity model 2021-02-13 12:55:04 -08:00
Russell Grew e8da2d947a
Bash script edits to make stackSentinel.py faster in places (#225)
* plumb in num-process for time consuming steps

* refine num-process speed enhancements

* refine num-process speed enhancements

* dedicated function for writing batch processes

* refine num-process speed enhancements

* fix indents

Co-authored-by: Russell Grew <russell.grew@douglaspartners.com.au>
2021-02-04 13:58:36 -08:00
Ryan Burns ad1815ef9c Modernize gdal imports
GDAL has dropped support for the older toplevel `import gdal`
in version 3.2, now requiring `from osgeo import gdal`.
2021-01-06 13:24:26 -08:00
ranneylxr 48559c6e3e
using geopandas and shapely package to calculate whether there are intersections between bbox and sentinel SAFE file. (#216)
* stackSentinel.py:using geopandas to calculate intersection between bbox and SAFE file coverage region

* stackSentinel.py:using geopandas and shapely package to calculate whether there are intersections between bbox and sentinel SAFE file. And remove import geopandas and shapely part into generate_geopolygon function

* stackSentinel.py: using shapely package to check whether bbox intersect with SAFE file coverage

* stackSentinel.py: using shapely package to check whether bbox intersect with SAFE file coverage

* stackSentinel.py:using shapely package to find whether bbox intersects with SAFE file

* stackSentinel.py:remove matplotlib DEBUG message#L14-L18
2021-01-06 13:19:55 -08:00
Minyan Zhong c399d3fa03 clean up and update grossOffsets 2020-11-30 00:49:28 -08:00