UNICORE Changelog

What's new in UNICORE 7.4.0

Sep 7, 2015
  • Installer/General:
  • add configuration option for Globus-style gridmap file (https://sourceforge.net/p/unicore/feature-requests/372)
  • fix: XmlBeans/Saxon errors when running on JDK 8 (https://sourceforge.net/p/unicore/issues/29)
  • remove XUUDB normal mode option (it is deprecated) (https://sourceforge.net/p/unicore/issues/30)
  • Gateway:
  • updated libraries
  • UNICORE/X:
  • new feature: new WS method for deleting multiple child resources (https://sourceforge.net/p/unicore/issues/8)
  • new feature: publish computing time budget of a user (https://sourceforge.net/p/unicore/issues/24)
  • new feature: data triggering possible on shared storages (https://sourceforge.net/p/unicore/issues/24)
  • new feature: unified JSON job description (used with REST API and data triggering), now e.g. supports parameter sweeps (https://sourceforge.net/p/unicore/feature-requests/371)
  • new feature: MTOM support for ByteIO transfer (https://sourceforge.net/p/unicore/feature-requests/290)
  • fix: allow read access to StorageFactory properties for authenticated users (change in xacml2Policies/01coreServices.xml)
  • fix: properly log/report TSI errors when writing/reading data in BFT filetransfers (https://sourceforge.net/p/unicore/issues/12)
  • fix: potential NullPointerException in TargetSystem (https://sourceforge.net/p/unicore/issues/28)
  • fix: SMS operations (delete, rename, copy) are also performed on the metadata (https://sourceforge.net/p/unicore/bugs/811)
  • improvement: better reporting of connection status, e.g. UFTPD connection status
  • TSI:
  • improvement: add alternative implementation to get the supplementary groups, since users have reported one case where the current implementation did not work
  • fix: start_tsi script uses conf/ directory as fallback
  • Registry:
  • updated libraries
  • XUUDB:
  • updated libraries

New in UNICORE 7.3.0 (Sep 7, 2015)

  • Gateway:
  • new feature: pass on signed client DN (from the X.509 client certificate, if present) for non-SOAP requests (https://sourceforge.net/p/unicore/feature-requests/356)
  • fix: forwarding path with encoded characters did not work (https://sourceforge.net/p/unicore/bugs/790)
  • UNICORE/X:
  • new feature: support resource sharing via service ACLs (https://sourceforge.net/p/unicore/feature-requests/343)
  • new feature: flexible definition of shared storages (https://sourceforge.net/p/unicore/feature-requests/360)
  • new feature: user-specific application definitions (https://sourceforge.net/p/unicore/feature-requests/266)
  • new feature: allow to further optimize stage-in by using symbolic linking instead of physical copy (http://sourceforge.net/p/unicore/feature-requests/280)
  • new feature: REST API supports metadata and file permissions (http://sourceforge.net/p/unicore/feature-requests/363)
  • improvement: cache results of Unity authentication (https://sourceforge.net/p/unicore/feature-requests/359)
  • fix: handling "+" characters in storage paths was buggy (https://sourceforge.net/p/unicore/bugs/559)
  • fix: default umask for SMS is ignored (https://sourceforge.net/p/unicore/bugs/783)
  • fix: REST API: persist and unlock TSF instance correctly (https://sourceforge.net/p/unicore/bugs/780)
  • fix: S3 connector should use the UNICORE/X truststore (https://sourceforge.net/p/unicore/feature-requests/366)
  • fix: passing a reservation ID leads to job failure (https://sourceforge.net/p/unicore/bugs/789)
  • fix: REST API: errors may leave resource locked and unavailable (https://sourceforge.net/p/unicore/bugs/796)
  • fix: cleanup (and properly quote) scripts sent to TSI

New in UNICORE 7.2.0 (Sep 7, 2015)

  • Installer:
  • add TSI manual
  • Gateway:
  • fix: message charset was always ISO-8859-1, and UFT-8 characters were not properly transmitted (SF bug # 770)
  • initial support for multipart POST messages (but SOAP part must be first) (SF feature #292)
  • UNICORE/X:
  • new feature: support Unity with OIDC (SF feature #344)
  • new feature: support S3 as backend storage (SF feature #342)
  • fix: data triggering could miss some files
  • fix: file existence check (to compensate for slow filesystems) did not work (SF bug #762)
  • fix: REST authentication: only first authentication option was used, SAML AuthN was buggy
  • fix: SMS CreateDirectory did not report an error in case of failures (SF bug #777)
  • fix: allow to disable interactive execution of user apps on login node (SF bug #778)
  • fix: report failure to create a directory (with Perl TSI) (SF bug #777)
  • improvement: more complete REST API (support create SMS and TSS, paged job listings, etc)
  • improvement: add sample config for REST
  • TSI
  • fix: newline characters in filenames break listDirectory (SF #769)
  • fix: Slurm: remove extra "\n" when setting account
  • fix: cleanup SSL code, make it more portable with respect to IPv6/IPv4. Use separate key and certificate files.
  • fix: in non-SSL mode, configuring the tsi.njsport is mandatory
  • update docs on configuring SSL
  • add section on securing/hardening the TSI to the manual

New in UNICORE 7.1.1 (Oct 23, 2014)

  • All except TSI - fix - disable SSLv3 protocol (due to the "POODLE" vulnerability)
  • UNICORE/X - fix -REST path handling in file up-/download

New in UNICORE 7.1.0 (Sep 30, 2014)

  • Gateway:
  • fix: HTTP headers for non-SOAP requests (SF bug #752)
  • improvement: better throughput for HTTP GET, PUT etc
  • UNICORE/X:
  • new feature: initial REST support (job submission, storage access, data movement)
  • fix: TSI setup documentation (SF bug #751)
  • fix: NPE when accessing a job that was previously deleted (SF bug #755)
  • fix: (harmless) error related to delegation in server-server transfers (SF bug #756)
  • new feature: XSEDE accounting helper (SF feature #335)
  • new feature: allow user pre/post command (on login node) for any job (SF feature #315)
  • new feature: allow expressions in resource requests (SF feature #319)
  • TSI:
  • new feature: allow to configure TSI listen interface (SF feature #336)
  • improvement: better file write performance. NOTE: there is a new Perl module PutFileChunk.pm and changes to MainLoop.pm

New in UNICORE 7.0.0 (May 15, 2014)

  • Additions and changes:
  • The client is now based on Eclipse 3.7.2 Indigo. The client was updated to UNICORE 7 libraries, including support for username/password authentication using Unity
  • Metadata management support (SF feature #297)
  • Support for getting short-lived certificate from MyProxy (SF feature #306)
  • Support for using directory as truststore (SF feature #305)
  • Workflow files can be marked transient, so they are not copied to workflow storage (SF feature #314)
  • Workflow resume including parameter change (SF feature #311)
  • Improved workflow options support (SF features #303, 304)
  • Show owner, group and UNIX permissions for files and folders in the "details" view
  • Allow to restart finished jobs
  • GSISSH Terminal is not included in this version due to issues with both our code and the jGlobus APIs
  • Bug fixes:
  • "Cancel" buttons on several dialogs were ignored (SF bug #673)

New in UNICORE 6.6.1 P2 (Mar 13, 2014)

  • Bug fixes:
  • fix SF bug #674, which was about ignoring dialog return values

New in UNICORE 6.6.1 P1 (Mar 13, 2014)

  • Bug fixes:
  • fix SF bug #659, unfortunately this re-opens bug #652

New in UNICORE 6.6.1 (Mar 13, 2014)

  • Bug fixes:
  • If possible (i.e. a site is selected), the resource panel shows the real resource defaults of the site (SF bug #652)
  • When creating an storage on a storage factory, but canceling the expiration time dialog, the storage was be created anyway (SF bug #651)
  • Fixed a classloading problem when using the very latest workflow engine
  • When the preferred filetransfer protocol is not supported by the site, file upload/download was failing. Now, BFT is used as fallback.
  • Harmonized capitalization of menu entries
  • Fixed workflow export for UCC (SF bug #649)
  • Additions and changes:
  • support file indirection in for-each, will be useable with the next release (6.6.0) of the workflow system (SF feature #300)
  • EXPERIMENTAL first version of metadata management support (SF feature #297)

New in UNICORE 6.6.0 (Mar 13, 2014)

  • Additions and changes:
  • Update to UNICORE 6.6.0 base client libraries.
  • Setting JSDL overwrite flag (SF feature request 3599337) might not be supported for all protocols by the server
  • By default public name of client host is no longer guess for UFTP transfers which is suggested behavior for UNICORE/X 6.6+
  • Added option for switching encryption during UFTP transfers
  • Support for hold activity added hold structure in workflow editor and resume operation available for held workflows in Grid browser
  • Simplied "New registry" dialog by removing the multicast discovery options
  • Support for scheduled start time of jobs (i.e. define time when job is submitted to the batch system)
  • Bug fixes:
  • Switching from workflow file to UNICORE Storage in a file export and then modifying the file name in the job working directory could cause an exception
  • When submitting a job without browsing the Target System first, the "jobs" node was called "Enumeration" in the Grid Browser
  • Empty arguments for jobs were still written to the JSDL
  • Avoid immediate refresh of all files when opening a storage or folder node
  • Fix refresh after deleting multiple nodes (e.g. jobs)
  • Fix NPE when handling execution environments

New in UNICORE 6.4.4 (Jun 19, 2013)

  • Additions and changes:
  • Allow for deleting application GUIs from Workflow Editor palette
  • Mark sub-workflows which failed only due to parent workflow failure "aborted" instead of failed facilitates finding the jobs that actually failed
  • Bug fixes:
  • Numeric site specific resources could not be requested (SourceForge Bug #3568390)
  • File transfers fail after renaming a for-loop (SourceForge Bug #3547853)
  • Jobs created with old application GUIs could not be restored properly
  • The Grid browser occasionally threw a ConcurrentModificationException
  • Workflow monitoring could stop before workflow had finished
  • Exceptions could be thrown when closing job and workflwo trace editors immediately after opening them
  • Application GUIs could not define their own parameter types
  • Application GUIs that were installed via Eclipse update sites were not uninstalled when their parent feature was uninstalled
  • The dialog for selecting job input files from UNICORE storages did not handle file name search strings correctly
  • Job resource requirements could get lost when renaming jobs or switching target systems in the resource panel

New in UNICORE 6.4.3 (Jun 19, 2013)

  • Additions and changes:
  • Improved dialog for staging in from UNICORE storages, supports filtering now (note that wildcard usage only works with UNICORE workflow engine >= 6.4.0)
  • When staging in files with wildcards, file names can now be influenced(only works with UNICORE workflow engine >= 6.4.0)
  • Known Grid files in the Grid browser are now persisted when closing the client(up to a certain max number which can be set through the preferences)
  • Hidden files are filtered out by default in the Grid browser
  • The Grid browser's filter settings are not lost when client closes
  • Added ability to import and export DER formatted certificates
  • Extended operating system selection for jobs, added mechanism for typing inany OS that is supported by JSDL
  • Execution environments can be configured even if target system is not selected(server-side brokering of such jobs only works with workflow engine >= 6.4.0)
  • Changes to the application GUI directories are detected automatically (with apossible delay of 20 seconds) and the workflow palette is updated accordingly
  • File and variable tables in job editor can now be scrolled for submitted jobs
  • Grid Browser node names do not contain hostnames anymore
  • Improved "save as" dialog can now download directories
  • Added support for downloading client configs (trusted CAs, registry URL)
  • Bug fixes:
  • HTTP proxy still not working correctly!(SourceForge Bug #3436456)
  • Workflow editor was incompatible with Java 7 (due to XStream library)(SourceForge Bug #3481606)
  • Exported workflow descriptions could not be deleted(SourceForge Bug #3476622)
  • Special characters in job name lead to exception fetching outcomes(SourceForge Bug #3488502)
  • Multiple application GUI directories not handled correctly
  • When using chunked for-loops, file names in job working directorieswere accidently appended with multiple asterisks
  • When enabling execution environments without explicitly selecting onethere was a discrepancy between the GUI and the resulting job
  • Execution environment versions not handled correctly
  • User wasn't asked to save job when closing the job editor immediatelyafter modifying a text field value
  • Problems with special characters in workspace path (e.g. ä, ö, é)
  • Known issues and limitations;
  • Eclipse bug #329871 (https://bugs.eclipse.org/bugs/show_bug.cgi?id=329871)may lead to stack overflows and client hangs during startup. This can only befixed by migrating to a newer Eclipse version.

New in UNICORE 6.4.2 (Jan 17, 2012)

  • Bug fixes:
  • Preferences lost due to early preference access during startup
  • HTTP proxy support was broken
  • Node selection changes in the Grid browser after triggering destroy
  • action lead to destruction of wrong resources
  • Certificates with multiple attributes (e.g. CNs) not displayed right
  • When a job failed, the execution log could not be displayed through
  • the event dialog as intended
  • Validation of user commands for execution environments broken

New in UNICORE 6.4.1 (Sep 19, 2011)

  • Additions and changes
  • The URC is now based on the new UNICORE 6.4.x client libraries
  • Support for the new UFTP file transfer protocol using parallel TCP streams
  • Client asks user before overwriting files when fetching job outcomes
  • Two new condition types are available in the workflow editor: file existence test and date/time test (see enhancement request #3071743)
  • Workflow structures now possess headers displaying name and execution state
  • Improved certificate details view: extended key usage and basic constraints
  • certificate extensions are shown
  • Better handling of unrecognized problems: the URC now tries to generate an
  • identifier for such problems allowing the user to ignore them in the future
  • New function for destroying all jobs on a particular target system (available
  • via the context menu of target system's Jobs node in the Grid Browser)
  • The workflow editor avoids activity overlaps when expanding structures
  • Bug fixes
  • FIXED: In Windows, variable modifier expressions had to be entered backwards
  • FIXED: File handle not closed on exported jks archive
  • (SourceForge Bug #3165967)
  • FIXED: Exception when pressing cancel while exporting CA certificates
  • FIXED: Refreshing unreachable services in the Grid Browser could lead to a
  • NullPointerException in rare circumstances
  • FIXED: Generic application GUI not initialized correctly when re-opening job
  • FIXED: Generic application GUI may have added ARGUMENTS variable twice
  • FIXED: Collapsed activities handled incorrectly when using automatic layouts
  • FIXED: SWT replacement for internal browser based welcome screen was broken.
  • FIXED: Client hanging and performing badly when triggering and monitoring
  • many (~1000) server-to-server file transfers. Hint: better transfer the parent
  • directory instead of thousands of files individually, this is much faster.

New in UNICORE 6.3.1 (Sep 27, 2010)

  • General:
  • based on UNICORE 6.3.1 base libraries
  • updated config files
  • added redhat init scripts in "extras"
  • Workflow Engine:
  • fix: "detailed status is messed up (SF bug #2987550)
  • new feature: "repeat-until" and "while" constructs
  • new feature: chunked "for" loop (SF feature #2811556)
  • fix: "NPE in workflow service" (SF bug #2986664)
  • fix: accessible workflow enumeration always showed zero results
  • (SF bug #2978384)
  • SECURITY FIX: expression evaluation now runs in a secured
  • environment (sandbox)
  • replace beanshell by groovy in expression evaluator
  • fix groovy DSL (SF bug #3049316)
  • add "FLOAT" variable type
  • Service orchestrator:
  • fix: "logical name already in use error" (SF bug #3027079)
  • fix: avoid excessive creation of target systems

New in UNICORE 6.3.0 (Feb 8, 2010)

  • depends on UNICORE 6.3.0 libraries
  • support for new StorageFactory service
  • new "create-storage" command
  • new "connect-to-testgrid" command for gaining access to the
  • public testgrid at http://www.unicore.eu/testgrid
  • add "ucc shell" commandline completion for filenames
  • add "mkdir" and "rm" commands
  • fix trust delegation in "copy-file"
  • split code into multiple modules
  • commands to access OGSA-BES services included into the distribution
  • allow to issue a TD assertion using just a site name
  • fix batch mode to exit when not connected to any sites
  • fix non-working "brief" option to "Run" command
  • allow to specify both total cpus and nodes+cpus per node.
  • support specifying remote login via a user assertion (option '-U')
  • consistent non-zero exit code in case of errors
  • nicer output of file and storage sizes in "ls" and "list-storages"

New in UNICORE 6.2.1 (Jul 20, 2009)

  • General:
  • make update.sh script sh-compatible (fixes errors on Ubuntu)
  • GUI installer fixes (wrong IDB on Windows, removed files that are not needed)
  • add install.py helper that copies only the necessary files to the
  • installation directory (sf bug 2184302)
  • smarter component start/stop scripts: wait for server shutdown,
  • avoid accidentally starting multiple times, better stop order in
  • top-level stop.sh
  • included UDT C++ source code in the udt-src folder
  • Windows IDB includes .bat file execution "CMD shell"
  • Gateway:
  • improved connection logging (peer address, peer DN) and
  • error logging (sf feature 2038886)
  • allow to disable the detailed site listing (sf feature 2807790)
  • site details show connection error details in addition to the "sad monkey"
  • forward VSite HTTP errors to the client when doing HTTP PUT
  • UNICORE/X:
  • fix proxy generation from DSA keys (sf bug 2545056)
  • refactored XNJS storage handling. This makes it much easier to integrate
  • new storage backends
  • CIP info provider is published to registry (sf feature 2788384)
  • fix import to storage root dir, which caused a "chmod 0600" (sf bug 2808523)
  • fix bug when filetransfer instances could not be destroyed
  • new Apache Hadoop integration module (experimental)
  • improved map-file authoriser
  • new TSI parameter TSI_PROCESSORS_PER_NODE and TSI_TOTAL_PROCESSORS
  • (with obvious semantics). Existing TSI_PROCESSORS is kept.
  • simplified UDT module (no longer needs the 'empty' utility)
  • fix message signing verification problems when using p12 keystore
  • and separate truststore (by using latest WSS4J)
  • destroying a file transfer will now cancel the running transfer
  • TSI:
  • fix PutFiles.pm to handle paths containing spaces
  • improved ExecuteScript.pm
  • new TSI_TOTAL_PROCESSORS and TSI_PROCESSORS_PER_NODE variables
  • Registry:
  • access control on the Registry (sf feature 2807780).
  • See registry/conf/uas.config for more information
  • individual entries can be deleted (using e.g. "ucc wsrf destroy")
  • but only if access control is enabled
  • XUUDB:
  • fix duplicate xlogin when running the admin.sh add command twice
  • (sf bug 2797971)
  • allow overwriting CSV file when exporting (sf feature 2779253)
  • "admin.sh list" prints XUUDB info (server version, DN/normal mode)
  • (sf feature 2797975)
  • fix DN format used in "update" command (sf bug 2803417)
  • do not allow "adddn" command if not in DN mode (sf bug 2807632)

New in UNICORE 6.2.0 P1 (Jul 15, 2009)

  • General:
  • fix path in ucc start script
  • UNICORE/X:
  • add configuration file entry and GLUE document for the
  • CIS Infoprovider
  • fix missing address in auto-generated WSDL (which
  • caused GPE clients to fail)
  • XUUDB:
  • fix DN representation in admin tool adddn and import commands
  • TSI:
  • SGE: fix missing semicolon