What's new in UNICORE 7.4.0
Sep 7, 2015
- Installer/General:
- add configuration option for Globus-style gridmap file (https://sourceforge.net/p/unicore/feature-requests/372)
- fix: XmlBeans/Saxon errors when running on JDK 8 (https://sourceforge.net/p/unicore/issues/29)
- remove XUUDB normal mode option (it is deprecated) (https://sourceforge.net/p/unicore/issues/30)
- Gateway:
- updated libraries
- UNICORE/X:
- new feature: new WS method for deleting multiple child resources (https://sourceforge.net/p/unicore/issues/8)
- new feature: publish computing time budget of a user (https://sourceforge.net/p/unicore/issues/24)
- new feature: data triggering possible on shared storages (https://sourceforge.net/p/unicore/issues/24)
- new feature: unified JSON job description (used with REST API and data triggering), now e.g. supports parameter sweeps (https://sourceforge.net/p/unicore/feature-requests/371)
- new feature: MTOM support for ByteIO transfer (https://sourceforge.net/p/unicore/feature-requests/290)
- fix: allow read access to StorageFactory properties for authenticated users (change in xacml2Policies/01coreServices.xml)
- fix: properly log/report TSI errors when writing/reading data in BFT filetransfers (https://sourceforge.net/p/unicore/issues/12)
- fix: potential NullPointerException in TargetSystem (https://sourceforge.net/p/unicore/issues/28)
- fix: SMS operations (delete, rename, copy) are also performed on the metadata (https://sourceforge.net/p/unicore/bugs/811)
- improvement: better reporting of connection status, e.g. UFTPD connection status
- TSI:
- improvement: add alternative implementation to get the supplementary groups, since users have reported one case where the current implementation did not work
- fix: start_tsi script uses conf/ directory as fallback
- Registry:
- updated libraries
- XUUDB:
- updated libraries
New in UNICORE 7.3.0 (Sep 7, 2015)
- Gateway:
- new feature: pass on signed client DN (from the X.509 client certificate, if present) for non-SOAP requests (https://sourceforge.net/p/unicore/feature-requests/356)
- fix: forwarding path with encoded characters did not work (https://sourceforge.net/p/unicore/bugs/790)
- UNICORE/X:
- new feature: support resource sharing via service ACLs (https://sourceforge.net/p/unicore/feature-requests/343)
- new feature: flexible definition of shared storages (https://sourceforge.net/p/unicore/feature-requests/360)
- new feature: user-specific application definitions (https://sourceforge.net/p/unicore/feature-requests/266)
- new feature: allow to further optimize stage-in by using symbolic linking instead of physical copy (http://sourceforge.net/p/unicore/feature-requests/280)
- new feature: REST API supports metadata and file permissions (http://sourceforge.net/p/unicore/feature-requests/363)
- improvement: cache results of Unity authentication (https://sourceforge.net/p/unicore/feature-requests/359)
- fix: handling "+" characters in storage paths was buggy (https://sourceforge.net/p/unicore/bugs/559)
- fix: default umask for SMS is ignored (https://sourceforge.net/p/unicore/bugs/783)
- fix: REST API: persist and unlock TSF instance correctly (https://sourceforge.net/p/unicore/bugs/780)
- fix: S3 connector should use the UNICORE/X truststore (https://sourceforge.net/p/unicore/feature-requests/366)
- fix: passing a reservation ID leads to job failure (https://sourceforge.net/p/unicore/bugs/789)
- fix: REST API: errors may leave resource locked and unavailable (https://sourceforge.net/p/unicore/bugs/796)
- fix: cleanup (and properly quote) scripts sent to TSI
New in UNICORE 7.2.0 (Sep 7, 2015)
- Installer:
- add TSI manual
- Gateway:
- fix: message charset was always ISO-8859-1, and UFT-8 characters were not properly transmitted (SF bug # 770)
- initial support for multipart POST messages (but SOAP part must be first) (SF feature #292)
- UNICORE/X:
- new feature: support Unity with OIDC (SF feature #344)
- new feature: support S3 as backend storage (SF feature #342)
- fix: data triggering could miss some files
- fix: file existence check (to compensate for slow filesystems) did not work (SF bug #762)
- fix: REST authentication: only first authentication option was used, SAML AuthN was buggy
- fix: SMS CreateDirectory did not report an error in case of failures (SF bug #777)
- fix: allow to disable interactive execution of user apps on login node (SF bug #778)
- fix: report failure to create a directory (with Perl TSI) (SF bug #777)
- improvement: more complete REST API (support create SMS and TSS, paged job listings, etc)
- improvement: add sample config for REST
- TSI
- fix: newline characters in filenames break listDirectory (SF #769)
- fix: Slurm: remove extra "\n" when setting account
- fix: cleanup SSL code, make it more portable with respect to IPv6/IPv4. Use separate key and certificate files.
- fix: in non-SSL mode, configuring the tsi.njsport is mandatory
- update docs on configuring SSL
- add section on securing/hardening the TSI to the manual
New in UNICORE 7.1.1 (Oct 23, 2014)
- All except TSI - fix - disable SSLv3 protocol (due to the "POODLE" vulnerability)
- UNICORE/X - fix -REST path handling in file up-/download
New in UNICORE 7.1.0 (Sep 30, 2014)
- Gateway:
- fix: HTTP headers for non-SOAP requests (SF bug #752)
- improvement: better throughput for HTTP GET, PUT etc
- UNICORE/X:
- new feature: initial REST support (job submission, storage access, data movement)
- fix: TSI setup documentation (SF bug #751)
- fix: NPE when accessing a job that was previously deleted (SF bug #755)
- fix: (harmless) error related to delegation in server-server transfers (SF bug #756)
- new feature: XSEDE accounting helper (SF feature #335)
- new feature: allow user pre/post command (on login node) for any job (SF feature #315)
- new feature: allow expressions in resource requests (SF feature #319)
- TSI:
- new feature: allow to configure TSI listen interface (SF feature #336)
- improvement: better file write performance. NOTE: there is a new Perl module PutFileChunk.pm and changes to MainLoop.pm
New in UNICORE 7.0.0 (May 15, 2014)
- Additions and changes:
- The client is now based on Eclipse 3.7.2 Indigo. The client was updated to UNICORE 7 libraries, including support for username/password authentication using Unity
- Metadata management support (SF feature #297)
- Support for getting short-lived certificate from MyProxy (SF feature #306)
- Support for using directory as truststore (SF feature #305)
- Workflow files can be marked transient, so they are not copied to workflow storage (SF feature #314)
- Workflow resume including parameter change (SF feature #311)
- Improved workflow options support (SF features #303, 304)
- Show owner, group and UNIX permissions for files and folders in the "details" view
- Allow to restart finished jobs
- GSISSH Terminal is not included in this version due to issues with both our code and the jGlobus APIs
- Bug fixes:
- "Cancel" buttons on several dialogs were ignored (SF bug #673)
New in UNICORE 6.6.1 P2 (Mar 13, 2014)
- Bug fixes:
- fix SF bug #674, which was about ignoring dialog return values
New in UNICORE 6.6.1 P1 (Mar 13, 2014)
- Bug fixes:
- fix SF bug #659, unfortunately this re-opens bug #652
New in UNICORE 6.6.1 (Mar 13, 2014)
- Bug fixes:
- If possible (i.e. a site is selected), the resource panel shows the real resource defaults of the site (SF bug #652)
- When creating an storage on a storage factory, but canceling the expiration time dialog, the storage was be created anyway (SF bug #651)
- Fixed a classloading problem when using the very latest workflow engine
- When the preferred filetransfer protocol is not supported by the site, file upload/download was failing. Now, BFT is used as fallback.
- Harmonized capitalization of menu entries
- Fixed workflow export for UCC (SF bug #649)
- Additions and changes:
- support file indirection in for-each, will be useable with the next release (6.6.0) of the workflow system (SF feature #300)
- EXPERIMENTAL first version of metadata management support (SF feature #297)
New in UNICORE 6.6.0 (Mar 13, 2014)
- Additions and changes:
- Update to UNICORE 6.6.0 base client libraries.
- Setting JSDL overwrite flag (SF feature request 3599337) might not be supported for all protocols by the server
- By default public name of client host is no longer guess for UFTP transfers which is suggested behavior for UNICORE/X 6.6+
- Added option for switching encryption during UFTP transfers
- Support for hold activity added hold structure in workflow editor and resume operation available for held workflows in Grid browser
- Simplied "New registry" dialog by removing the multicast discovery options
- Support for scheduled start time of jobs (i.e. define time when job is submitted to the batch system)
- Bug fixes:
- Switching from workflow file to UNICORE Storage in a file export and then modifying the file name in the job working directory could cause an exception
- When submitting a job without browsing the Target System first, the "jobs" node was called "Enumeration" in the Grid Browser
- Empty arguments for jobs were still written to the JSDL
- Avoid immediate refresh of all files when opening a storage or folder node
- Fix refresh after deleting multiple nodes (e.g. jobs)
- Fix NPE when handling execution environments
New in UNICORE 6.4.4 (Jun 19, 2013)
- Additions and changes:
- Allow for deleting application GUIs from Workflow Editor palette
- Mark sub-workflows which failed only due to parent workflow failure "aborted" instead of failed facilitates finding the jobs that actually failed
- Bug fixes:
- Numeric site specific resources could not be requested (SourceForge Bug #3568390)
- File transfers fail after renaming a for-loop (SourceForge Bug #3547853)
- Jobs created with old application GUIs could not be restored properly
- The Grid browser occasionally threw a ConcurrentModificationException
- Workflow monitoring could stop before workflow had finished
- Exceptions could be thrown when closing job and workflwo trace editors immediately after opening them
- Application GUIs could not define their own parameter types
- Application GUIs that were installed via Eclipse update sites were not uninstalled when their parent feature was uninstalled
- The dialog for selecting job input files from UNICORE storages did not handle file name search strings correctly
- Job resource requirements could get lost when renaming jobs or switching target systems in the resource panel
New in UNICORE 6.4.3 (Jun 19, 2013)
- Additions and changes:
- Improved dialog for staging in from UNICORE storages, supports filtering now (note that wildcard usage only works with UNICORE workflow engine >= 6.4.0)
- When staging in files with wildcards, file names can now be influenced(only works with UNICORE workflow engine >= 6.4.0)
- Known Grid files in the Grid browser are now persisted when closing the client(up to a certain max number which can be set through the preferences)
- Hidden files are filtered out by default in the Grid browser
- The Grid browser's filter settings are not lost when client closes
- Added ability to import and export DER formatted certificates
- Extended operating system selection for jobs, added mechanism for typing inany OS that is supported by JSDL
- Execution environments can be configured even if target system is not selected(server-side brokering of such jobs only works with workflow engine >= 6.4.0)
- Changes to the application GUI directories are detected automatically (with apossible delay of 20 seconds) and the workflow palette is updated accordingly
- File and variable tables in job editor can now be scrolled for submitted jobs
- Grid Browser node names do not contain hostnames anymore
- Improved "save as" dialog can now download directories
- Added support for downloading client configs (trusted CAs, registry URL)
- Bug fixes:
- HTTP proxy still not working correctly!(SourceForge Bug #3436456)
- Workflow editor was incompatible with Java 7 (due to XStream library)(SourceForge Bug #3481606)
- Exported workflow descriptions could not be deleted(SourceForge Bug #3476622)
- Special characters in job name lead to exception fetching outcomes(SourceForge Bug #3488502)
- Multiple application GUI directories not handled correctly
- When using chunked for-loops, file names in job working directorieswere accidently appended with multiple asterisks
- When enabling execution environments without explicitly selecting onethere was a discrepancy between the GUI and the resulting job
- Execution environment versions not handled correctly
- User wasn't asked to save job when closing the job editor immediatelyafter modifying a text field value
- Problems with special characters in workspace path (e.g. ä, ö, é)
- Known issues and limitations;
- Eclipse bug #329871 (https://bugs.eclipse.org/bugs/show_bug.cgi?id=329871)may lead to stack overflows and client hangs during startup. This can only befixed by migrating to a newer Eclipse version.
New in UNICORE 6.4.2 (Jan 17, 2012)
- Bug fixes:
- Preferences lost due to early preference access during startup
- HTTP proxy support was broken
- Node selection changes in the Grid browser after triggering destroy
- action lead to destruction of wrong resources
- Certificates with multiple attributes (e.g. CNs) not displayed right
- When a job failed, the execution log could not be displayed through
- the event dialog as intended
- Validation of user commands for execution environments broken
New in UNICORE 6.4.1 (Sep 19, 2011)
- Additions and changes
- The URC is now based on the new UNICORE 6.4.x client libraries
- Support for the new UFTP file transfer protocol using parallel TCP streams
- Client asks user before overwriting files when fetching job outcomes
- Two new condition types are available in the workflow editor: file existence test and date/time test (see enhancement request #3071743)
- Workflow structures now possess headers displaying name and execution state
- Improved certificate details view: extended key usage and basic constraints
- certificate extensions are shown
- Better handling of unrecognized problems: the URC now tries to generate an
- identifier for such problems allowing the user to ignore them in the future
- New function for destroying all jobs on a particular target system (available
- via the context menu of target system's Jobs node in the Grid Browser)
- The workflow editor avoids activity overlaps when expanding structures
- Bug fixes
- FIXED: In Windows, variable modifier expressions had to be entered backwards
- FIXED: File handle not closed on exported jks archive
- (SourceForge Bug #3165967)
- FIXED: Exception when pressing cancel while exporting CA certificates
- FIXED: Refreshing unreachable services in the Grid Browser could lead to a
- NullPointerException in rare circumstances
- FIXED: Generic application GUI not initialized correctly when re-opening job
- FIXED: Generic application GUI may have added ARGUMENTS variable twice
- FIXED: Collapsed activities handled incorrectly when using automatic layouts
- FIXED: SWT replacement for internal browser based welcome screen was broken.
- FIXED: Client hanging and performing badly when triggering and monitoring
- many (~1000) server-to-server file transfers. Hint: better transfer the parent
- directory instead of thousands of files individually, this is much faster.
New in UNICORE 6.3.1 (Sep 27, 2010)
- General:
- based on UNICORE 6.3.1 base libraries
- updated config files
- added redhat init scripts in "extras"
- Workflow Engine:
- fix: "detailed status is messed up (SF bug #2987550)
- new feature: "repeat-until" and "while" constructs
- new feature: chunked "for" loop (SF feature #2811556)
- fix: "NPE in workflow service" (SF bug #2986664)
- fix: accessible workflow enumeration always showed zero results
- (SF bug #2978384)
- SECURITY FIX: expression evaluation now runs in a secured
- environment (sandbox)
- replace beanshell by groovy in expression evaluator
- fix groovy DSL (SF bug #3049316)
- add "FLOAT" variable type
- Service orchestrator:
- fix: "logical name already in use error" (SF bug #3027079)
- fix: avoid excessive creation of target systems
New in UNICORE 6.3.0 (Feb 8, 2010)
- depends on UNICORE 6.3.0 libraries
- support for new StorageFactory service
- new "create-storage" command
- new "connect-to-testgrid" command for gaining access to the
- public testgrid at http://www.unicore.eu/testgrid
- add "ucc shell" commandline completion for filenames
- add "mkdir" and "rm" commands
- fix trust delegation in "copy-file"
- split code into multiple modules
- commands to access OGSA-BES services included into the distribution
- allow to issue a TD assertion using just a site name
- fix batch mode to exit when not connected to any sites
- fix non-working "brief" option to "Run" command
- allow to specify both total cpus and nodes+cpus per node.
- support specifying remote login via a user assertion (option '-U')
- consistent non-zero exit code in case of errors
- nicer output of file and storage sizes in "ls" and "list-storages"
New in UNICORE 6.2.1 (Jul 20, 2009)
- General:
- make update.sh script sh-compatible (fixes errors on Ubuntu)
- GUI installer fixes (wrong IDB on Windows, removed files that are not needed)
- add install.py helper that copies only the necessary files to the
- installation directory (sf bug 2184302)
- smarter component start/stop scripts: wait for server shutdown,
- avoid accidentally starting multiple times, better stop order in
- top-level stop.sh
- included UDT C++ source code in the udt-src folder
- Windows IDB includes .bat file execution "CMD shell"
- Gateway:
- improved connection logging (peer address, peer DN) and
- error logging (sf feature 2038886)
- allow to disable the detailed site listing (sf feature 2807790)
- site details show connection error details in addition to the "sad monkey"
- forward VSite HTTP errors to the client when doing HTTP PUT
- UNICORE/X:
- fix proxy generation from DSA keys (sf bug 2545056)
- refactored XNJS storage handling. This makes it much easier to integrate
- new storage backends
- CIP info provider is published to registry (sf feature 2788384)
- fix import to storage root dir, which caused a "chmod 0600" (sf bug 2808523)
- fix bug when filetransfer instances could not be destroyed
- new Apache Hadoop integration module (experimental)
- improved map-file authoriser
- new TSI parameter TSI_PROCESSORS_PER_NODE and TSI_TOTAL_PROCESSORS
- (with obvious semantics). Existing TSI_PROCESSORS is kept.
- simplified UDT module (no longer needs the 'empty' utility)
- fix message signing verification problems when using p12 keystore
- and separate truststore (by using latest WSS4J)
- destroying a file transfer will now cancel the running transfer
- TSI:
- fix PutFiles.pm to handle paths containing spaces
- improved ExecuteScript.pm
- new TSI_TOTAL_PROCESSORS and TSI_PROCESSORS_PER_NODE variables
- Registry:
- access control on the Registry (sf feature 2807780).
- See registry/conf/uas.config for more information
- individual entries can be deleted (using e.g. "ucc wsrf destroy")
- but only if access control is enabled
- XUUDB:
- fix duplicate xlogin when running the admin.sh add command twice
- (sf bug 2797971)
- allow overwriting CSV file when exporting (sf feature 2779253)
- "admin.sh list" prints XUUDB info (server version, DN/normal mode)
- (sf feature 2797975)
- fix DN format used in "update" command (sf bug 2803417)
- do not allow "adddn" command if not in DN mode (sf bug 2807632)
New in UNICORE 6.2.0 P1 (Jul 15, 2009)
- General:
- fix path in ucc start script
- UNICORE/X:
- add configuration file entry and GLUE document for the
- CIS Infoprovider
- fix missing address in auto-generated WSDL (which
- caused GPE clients to fail)
- XUUDB:
- fix DN representation in admin tool adddn and import commands
- TSI:
- SGE: fix missing semicolon