I'm proposing a fix to create_cmds.py since I found a minor bug in line 165 which doesn't remove the excluded dates during image stacking. Instead line 165 removes dates based on the dates not included from the dates to be included parameter on the alosStack.xml.
The image folder contains the ALOS-2 images with dates 191005, 191019, 191102, 191214, 191228.
I've tested the changes and it worked properly.
Co-authored-by: Ryan Burns <rtburns@jpl.nasa.gov>
* Changes to fetchOrbit.py to download orbit files in the new ESA website
I've made changes to the fetchOrbit.py to download the files on the https://scihub.copernicus.eu/gnss/#/home. I've used the generic credentials to query and download the orbit files.
* Update fetchOrbit.py
* Make output path generic
I've used os.path.join on line no. 165 to make it more generic.
* Set the verify option to true
I've set the verify option to True to remove the warning regarding "Unverified HTTPS request".
* Changes to the download link of the fetchOrbit.py
The download link before uses the href link on the XML of the website. It was properly working right until yesterday when it didn't work properly.
Instead I've edited the script to be consistent instead with the download link on the scihub copernicus GNSS website. I've tested it and it worked properly.
* Update fetchOrbit.py
+ support full resolution geometry files without ".full" in the filename, such as provided by stripmapStack
+ add --fix-xml option to update the image file path in the xml file, so that IML.loadImage is not called all the time, which could lead to file access issue when multiple processes use the same SLC file
After running the currently modified fetchOrbits.py, I've found out that the downloaded precise orbits were based on the date that they were processed instead of the date that they can be used. I've also modified the code to prevent downloading of restituted orbit if the precise orbit is available.
Pls. check if the changes I've made applies the orbit files to the Sentinel-1 SLC images properly.
PyCuAmpcor/examples/cuDenseOffsets:
+ add prepareGeometry() to generate the cooresponding geometry file
+ update file path in xml file to support dir change
+ fix str.decode bug with try/except statement
+ printout used time
+ check --redo before initiate PyCuAmpcor to avoid the long GPU memory error message
PyCuAmpcor/README.md: fix typos for ROIPAC
* stackStripMap.py: change numbering style to match with topsStack
* Stack.py: separate parallel processors in topo.py from runfiles
* stackSentinel.py: add a new argument for parallel processors in topo.py
* Stack.py: remove extra num_process for unpackStackReferenceSLC
* stackSentinel.py: tie numProcess4topo to numProcessif the first not specified
* stackSentinel.py:using geopandas to calculate intersection between bbox and SAFE file coverage region
* stackSentinel.py:using geopandas and shapely package to calculate whether there are intersections between bbox and sentinel SAFE file. And remove import geopandas and shapely part into generate_geopolygon function
* stackSentinel.py: using shapely package to check whether bbox intersect with SAFE file coverage
* stackSentinel.py: using shapely package to check whether bbox intersect with SAFE file coverage
* stackSentinel.py:using shapely package to find whether bbox intersects with SAFE file
* stackSentinel.py:remove matplotlib DEBUG message#L14-L18
* added a README.md for installation/user guide/procedures
* modified the cuDenseOffsets.py
* expose more options from the CUDA/C++ program
* add an option for varying gross offset input
* clarify the parameter definitions
* removed old SlcImage implementation and cublas dependence
* modified cuSincOversampler
* to be consistent with cpu version
* fix an issue when the extraction of the search window is not around the center
* added a debug mode to output intermediate results
* enable cuda error checking for both Debug/Release build types
* corrected the code to extract raw images when the correlation surface peak is close to edges
* Move utf-8 decoding step inside cython extension
The cython setters take python strings, but the getters return
python bytes, so this makes the types match up. I went with regular
python strings for the interface since they are more common at the
python level, so the encoding/decoding is now an implementation detail
of the cython extension.
Contributed by lijun99, rtburns-jpl, vbrancat, mzzhong
* added option to pass segment number through unpackFrame_UAVSAR
* changed type of segment number
* changed segment type in prepareUAVSAR_coregstack
* Revert "changed type of segment number"
This reverts commit a18c6452d4b5c95ce869dab2ee1e3bcf6ff2b1d9.
* Revert "changed segment type in prepareUAVSAR_coregstack"
This reverts commit 6cf3ebadb3a6e119c6084c8e03b8cc68d7eccc3f.
* changed type of segment number in unpackFrame_UAVSAR
* Added code to stripmapStack/topo.py to explicitly create the `geom_reference/hgt.rdr.vrt` file to work with newer GDAL
* ImageLib: fix str syntax
* stackSentl: rename slc workflow merge for consistency
rename the mergeSLC step in "slc" workflow, to be consistent with the other workflows.
* topsStack: check inconsistent num of bursts in secondary images
+ extractCommonValidRegion.py: add dropSecondarysWithDifferentNumberOfBursts() to discard those acquisitions during the common region calculation
+ mergeBursts.py: skip secondarys with inconsistent num of bursts by raise exception and exit
+ s1a_isce_utils.adjustValidSampleLine_V2(): remove a redundant line
Co-authored-by: Zhang Yunjun <yunjunz@users.noreply.github.com>
* stackSentl.createParser(): align break line
+ align linebreak of help msg
+ use choices=[] for auto argument checking
+ use (default: %(default)s) to show defult value
* stackSent: bugfix for new paris if ref date is close to recent
This commit fixs the missing pair between the reference date and the new acquisitions, if the reference date is the most recent "num_conn" acquisition.
* Stack: check existing orbit with glob instead of os.path.exist(dir)
* topsStack: add --num-proc for topo step
stackSentinel: add --num-proc to pass the number of parallel processes to topo.py, so that mp.Pool() can be independent of OMP_NUM_THREADS
Co-authored-by: Zhang Yunjun <yunjunz@users.noreply.github.com>
* added option to pass segment number through unpackFrame_UAVSAR
* changed type of segment number
* changed segment type in prepareUAVSAR_coregstack
* Revert "changed type of segment number"
This reverts commit a18c6452d4b5c95ce869dab2ee1e3bcf6ff2b1d9.
* Revert "changed segment type in prepareUAVSAR_coregstack"
This reverts commit 6cf3ebadb3a6e119c6084c8e03b8cc68d7eccc3f.
* changed type of segment number in unpackFrame_UAVSAR
* Silence annoying FindFFTW warnings
* Fix linker errors at import-time
Python extensions are weakly linked, so linker errors can only be
caught at runtime. This commit fixes any such broken extensions,
and adds automated import testing to ctests to prevent future
regressions.
It also adds a helper function `isce2_add_staticlib` which creates a
position-independent static library suitable for usage in multiple
python extensions. This matches the SCons build scripts more closely
and allows for future extensions to be declared in a more terse and
hygienic fashion.
* Update utilLib scripts
* Update combinedLib scripts
* Update offoutliers lib scripts
* Add asa_im_decode cdll
* Update alos lib scripts
* Show ctest output upon failure
* Update DataAccessor scripts
* Remove TARGET_FILE_BASE_NAME
* Remove incomplete stdproc modules (require stanford code)
Co-authored-by: Ryan Burns <rtburns-jpl@users.noreply.github.com>
+ update os.system() call of gdal2isce_xml.py with the python function call, in stripmapStack/topo.py and applications/downsampleDEM.py
+ break the long lines in downsampleDEM.py for easy reading
topsStack/FilterAndCoherence.py:
+ add .full suffix to the complex coherence filename only if the multilook number is 1
+ for multilook number as 1, do not run looks sub-module
topsStack/Stack.filter_coherence(): add .full suffix only when azLooks * rgLooks == 1
topsStack/mergeBursts.py: add python3 at the top of script
Otherwise, if 'stack' folder exists but is empty, the script will return ERROR as below:
```
/net/kraken/nobak/zyunjun/TonopahSenAT64/stack already exists.
Replacing master with existing stack.
updating the valid overlap region of:
/net/kraken/nobak/zyunjun/TonopahSenAT64/stack
******************
swath: 1
Traceback (most recent call last):
File "/home/zyunjun/tools/isce2/contrib/stack/topsStack/extractCommonValidRegion.py", line 109, in <module>
main()
File "/home/zyunjun/tools/isce2/contrib/stack/topsStack/extractCommonValidRegion.py", line 95, in main
topMaster = ut.loadProduct(os.path.join(inps.master , 'IW{0}.xml'.format(swath)))
File "/home/zyunjun/tools/isce2/contrib/stack/topsStack/s1a_isce_utils.py", line 26, in loadProduct
obj = pm.loadProduct(xmlname)
File "/net/kraken/home1/geomod/apps/rhel7/isce2-github/isce/components/iscesys/Component/ProductManager.py", line 25, in loadProduct
self.load(filename)
File "/net/kraken/home1/geomod/apps/rhel7/isce2-github/isce/components/iscesys/Component/Configurable.py", line 1407, in load
tmpProp, tmpFact, tmpMisc = FP.parse(filename)
File "/net/kraken/home1/geomod/apps/rhel7/isce2-github/isce/components/iscesys/Parsers/XmlParser.py", line 41, in parse
root = ET.parse(filename)
File "/net/kraken/home1/geomod/apps/anaconda3/lib/python3.7/xml/etree/ElementTree.py", line 1197, in parse
tree.parse(source, parser)
File "/net/kraken/home1/geomod/apps/anaconda3/lib/python3.7/xml/etree/ElementTree.py", line 587, in parse
source = open(source, "rb")
FileNotFoundError: [Errno 2] No such file or directory: '/net/kraken/nobak/zyunjun/TonopahSenAT64/stack/IW1.xml'
```
Bryan Marfito
Ryan Burns
Lijun Zhu
Russell Grew
Russell Grew
yunjunz
Ryan Burns
Sara Mirzaee
Sara Mirzaee
Zhang Yunjun
CunrenLiang
Ryan Burns
Minyan Zhong
Lijun Zhu
ranneylxr
CunrenLiang
Eric Fielding
piyushrpt
Gerald Manipon