This file describes changes in recent versions of pdsh. It primarily
documents those changes that are of interest to users and admins.
* Changes in pdsh-2.31 (2013-11-07)
===================================
-- Fix issue 56: slurm: Allow mixed use of -P, -w and -j options.
-- Fix issue 59: pdsh very slow when using a few thousand hosts and genders.
-- testsuite: Expanded tests for genders module (Pythagoras Watson)
* Changes in pdsh-2.30 (2013-03-02)
===================================
-- Fix issue 55: genders -X option removes more hosts than expected.
(This was a generic fix for hostname matching, so it probably
affected -x and other options as well.)
-- testsuite: Add test for issue 55.
* Changes in pdsh-2.29 (2013-02-12)
===================================
-- Fix issue 42: --with-dshgroup sets DSHGROUP_PATH to "yes"
-- Fix issue 53: Add -P option to target SLURM partitions (Michael Fenn)
-- Fix issue 54: pdsh prints empty lines with -S
-- pdcp: Add more levels of directory recursion (Pythagoras Watson)
* Changes in pdsh-2.28 (2011-10-19)
===================================
-- Fix issue 39: ssh forces use of -l<user> option
-- Fix issue 40: -l%u added to ssh args only if remote and local
usernames differ
-- testsuite: Added tests for -l%u handing in ssh
* Changes in pdsh-2.27 (2011-09-07)
===================================
-- Fix issue 17: Allow dshgroup files to include other files
-- Fix issue 33: dshbak breaks up host lists at zeropad boundaries,
(e.g. 01-09,10-11, 010-099,100-101, etc.)
-- Fix issue 34: dshgroup path override broken in ./configure
-- Fix issue 36: pdsh truncates output lines at 8K
-- dshgroup: Allow dshgroup search path to be overridden by DSHGROUP_PATH,
a colon-separated list of directories to search. $HOME/.dsh/group
is still always prepended to this path.
-- Allow wcoll files (-w ^file and WCOLL=file) to include other files
with a "#include FILE" syntax. If included files have no path, then
a search path of the dirname of the included file ("." for stdin)
is used.
-- testsuite: added tests, fixed some portability issues.
-- Fix some minor memory leaks and locking bugs reported by Coverity.
* Changes in pdsh-2.26 (2011-04-29)
===================================
-- Fix issue 14: interactive mode broken with ssh
-- Fix issue 19: missing commas in dshbak(1) header output
-- Fix issue 20: compilation error in genders.c with non-GCC compilers
-- Fix issue 23: compilation failure with --enable-static-modules
-- Fix issue 24: don't arbitrarily limit usernames to 16 characters
-- Fix issue 25: PDSH_SSH_ARGS should not require %u and %h
-- Fix issue 26: document use of %u and %h in PDSH_SSH_ARGS
-- Fix interactive mode with rcmd/exec.
-- genders: do not look for genders_query(3) support at runtime,
as this causes too many problems on some systems. Instead,
use autoconf to include or exclude genders_query support from
the genders module. (fixes Issue 1)
-- Fix build on AIX
-- Add -Wl,-E to LDFLAGS on HP-UX (Issue 18)
-- Fixes for testsuite portability (Issues 15, 22, 28)
* Changes in pdsh-2.25 (2011-03-09)
===================================
-- Fix pdcp breakage with ssh (bug introduced in pdsh-2.24).
(Resolves issue 12: pdcp executes file instead of copying.)
-- testsuite: Skip tests dependent on PDSH_MODULE_DIR when testsuite
run as root (Resolves issue 13: testsuite broken when run as root).
-- testsuite: Skip dshbak -d test to non-writable directory when
directory permissions do not seem to apply (e.g. privileged user).
(Possibly resolves issue 11: tests fail on Mac OSX under fink)
-- testsuite: add simple ssh tests.
* Changes in pdsh-2.24 (2011-02-28)
===================================
-- Resolve issue 7: Allow PDSH_REMOTE_PDCP_PATH to set default path
to remote pdcp program (pdcp -e).
-- Resolve issue 9: Fix use of PDSH_SSH_ARGS_APPEND.
-- Resolve issue 10: dshbak: Support writing output to file-per-host.
Adds new -d DIR and -f options to dshbak.
-- genders: Allow relative paths to genders files with -F and
PDSH_GENDERS_FILE.
-- genders: Don't print an error if genders file is missing, unless
a genders optin (-F, -a, -g, -i, -X) is explicitly used.
-- genders: Allow -g to be used with other node selection options as
a filter. For example: pdsh -w host[0-1024] -g attr1 ...
-- ssh: Better preservation of remote command args in ssh module.
Previous versions of pdsh would alwas collapse all args into
a single argument passed to ssh: "cmd arg1 arg2 ..." With this
fix the argv list will more closely match the form passed to pdsh.
-- Refactored large portions of dshbak, improve usage output,
and update manpage.
-- Expanded testsuite.
* Changes in pdsh-2.23 (2010-10-22)
===================================
-- Fix issue 4: List available but conflicting modules in -V and -L output.
-- Fix issue 5: dshbak -c doesn't properly coalesce hosts with different
zero-padding in the numeric suffix.
-- Added torque module for setting list of target hosts based on Torque/PBS
jobs (Issue 2).
-- Enhance syntax of -w and -x to allow preceeding arguments with:
`-' - Exclude hosts instead of include with -w ( -w foo[1-9],-foo8)
`^' - insert/exclude list of hosts from a file (^/path/to/file)
`/' - filter hosts based on regex (/host.*0$/)
-- Introduce new pdsh testsuite with many new tests. See tests/README
for more information.
* Changes in pdsh-2.22 (2010-09-03)
===================================
-- Fixes several bugs introduced in pdsh-2.21, Including:
- genders: segfault when genders file doesn't exist
- Failure to initialize some modules if others conflict
- -M option doesn't work in some cases
-- Sort modules by name before initialization so that modules
initialize in a reproducible order.
* Changes in pdsh-2.21 (2010-09-02)
===================================
-- New option -M name,... forces load of misc modules by
name, thus allowing users to select between conflicting
modules. (PDSH_MISC_MODULES environment variable may
also be used)
-- Due to above, an error is no longer printed when module
options conflict.
-- genders: Support PDSH_GENDERS_FILE environment variable to
override default genders file name (default = "genders")
-- genders: Support PDSH_GENDERS_DIR environment variable to
override default directory for genders files (default = /etc).
-- genders: Allow non-absolute path to be specified to -F option.
-- Fix parsing of hostlist expressions with multiple brackets
(from SF.net user don.fanucci)
-- Fix compile error on platforms where setnetgrent() doesn't
return an int.
-- Allow path to dshgroup files to be specified to ./configure
with --with-dshgroups=PATH.
-- Update libltdl
* Changes in pdsh-2.20 (2009-09-29)
===================================
-- Fix bug in pdcp which serialized copy of files to nodes
regardless of fanout.
* Changes in pdsh-2.19 (2009-05-21)
===================================
-- New pdsh configure option --with-rcmd-rank-list allows
the default pdsh rcmd module priority list to be overridden
at compile time.
-- genders: Always read genders file in case there are any
pdsh_rcmd_type attributes to apply to the target hosts.
-- genders: Fix bug where altnames were not used by default
in some cases due to a bug in generic module loading code.
(patch from Py Watson)
-- Fix for coredump when no rcmd module is loaded.
(patch from Py Watson)
-- %{_libdir}/pdsh should be owned by pdsh RPM.
(patch from Py Watson)
* Changes in pdsh-2.18 (2009-03-24)
===================================
-- Fix duplicate error output from ssh module.
(Patch from Paul D Smith <psmith at users.sourceforge.net>)
-- Add -e option to pdcp to explicitly specify remote execution path.
This is necessary if pdcp is installed in a different path locally
than on the target hosts.
-- Fix recursive pdcp (-r) which has been broken since pdsh-2.12.
-- Support --without-ssh-connect-timeout-option for ./configure.
-- Add note to pdsh(1) manpage that only very old versions of
the genders nodeattr script are supported by the pdsh nodeattr
module. The genders module is the preferred interface to genders.
* Changes in pdsh-2.17 (2008-09-23)
===================================
-- Ignore multiple consecutive ':' characters in host list argument to
-w option. Only a single ':' by itself will be interpreted as the
special "rcmd_type:hosts" syntax.
-- dshbak: Allow for ':' in pdsh output lines.
(patch from Ashley Pittman)
-- Fix for compile against glibc 2.8, which no longer defines ARG_MAX
(patch from Tom 'spot' Callaway via sf.net).
-- Include missing unistd.h in hostlist.h.
(patch from Ashley Pittman)
-- Fix compile on Solaris by updating to latest ACX_PTHREAD autoconf
macro from autoconf-archive.cryp.to.
* Changes in pdsh-2.16 (2008-03-19)
===================================
-- Don't attempt to read WCOLL file unless no other host
selection method is utilized.
-- (genders) Don't attempt to read a genders file if no genders
options are used.
-- When specifying rcmd_type via -w (i.e. [rcmd_type:][user@]host)
have rcmd_type apply across all hosts until the next rcmd
specification. That is ssh:host1,host2 now uses ssh for both
host1 and host2. Prior to this change, ssh would only be used
to contact host1. Same change for [user].
-- Check for valid fanout specified to -f option.
-- Always sort output of dshbak, and remove dshbak -s option.
-- Strip leading space (added by pdsh) from dsbak output.
* Changes in pdsh-2.15 (2007-10-24)
===================================
-- Refactor ssh module to use built in "pipecmd" support
(same code as the "exec" module)
-- Add connect timeout support for ssh implementations which support it.
By default, the OpenSSH "-oConnectTimeout=%d" option is used. This
can be overridden at configure time using
--with-ssh-connect-timeout-option="OPTION"
where OPTION should contain one %d which will be expanded to the
actual timeout value specified on the command line.
-- Add ncurses-devel to pdsh.spec BuildRequires.
* Changes in pdsh-2.14 (2007-06-22)
===================================
-- Fix compile error in src/pdsh/mod.c when using --enable-static-modules.
-- Allow conditional and static build of "exec" rcmd module.
-- (slurm) Re-order headers in slurm module to avoid redefinition
of pdsh bool type.
* Changes in pdsh-2.13 (2007-06-06)
===================================
-- New "exec" rcmd module for executing arbitrary commands.
(Thanks to Christopher Maestas <cdmaest at sandia dot gov>
for the idea.)
-- New -N option to disable hostname: prefix on lines of output.
-- dshbak: Allow host range compression for numerically keyed hosts
which have non-numeric suffix.
-- Fix for compilation problem on some machines for sshcmd.c.
-- Fix for erroneous command timeouts with ssh due to stray signals.
-- Fix handling of empty lines when parsing WCOLL files.
* Changes in pdsh-2.12 (2006-12-11)
===================================
-- Fix Solaris build.
-- New command rpdcp(1) ("reverse" pdcp) copies files from remote
hosts to the local machine (with remote hostname appended).
-- Do not truncate host domain in output labels if any domains differ.
-- (genders) Default user name may be specified to pdsh_rcmd_type attr
by prepending "user@".
-- (slurm) `-j' "all" parameter to target all nodes running SLURM jobs.
-- (slurm) Fix for build issue against slurm-1.0.
-- Minor code cleanup.
-- Minor RPM spec file cleanup.
* Changes in pdsh-2.11 (2006-07-26)
===================================
-- Fix for WCOLL file contents unconditionally added to host list.
Prior behavior was to have -w override WCOLL.
-- Supply more specific errors when pdsh detects that the path to
pdsh modules is insecure.
-- Fix man page typos.
-- Fix compile for Tru64.
-- (xcpu) Use lexec facility.
-- New dshbak -s option to sort output.
-- Allow users to cancel pending threads by issuing ctrl-C ctrl-Z
(ctrl-Z within one second of initial ctrl-C). Pending threads
are those threads which have not yet invoked a remote command.
* Changes in pdsh-2.10 (2006-03-22)
===================================
-- Fix for -w hosts parsing bug.
-- Fix missing support for "-w user@hosts" in pdsh-2.9.
-- Add support for command history in interactive mode with readline.
Command history file is ~/.pdsh/history.
-- (xcpu) Support for signals and -S.
* Changes in pdsh-2.9 (2006-03-15)
===================================
-- Add netgroup module which provides -g/-X groupname option to read
list of hosts from netgroup entries (/etc/netgroup or NIS).
-- Add support for specifying alternate rcmd connection type and/or
remote username for a subset of hosts on the commandline. Format
is ``-w [rcmd_type:][user@]hosts...''
-- (genders) Add support for pdsh_rcmd_type genders attribute to set
the default rcmd connection type for certain hosts via the genders
database.
-- Add a trivial form of privilege separation to pdsh when pdsh or pdcp
binaries are installed setuid root. This is necessary to safely support
multiple rcmd connection methods in a single invocation of pdsh.
Currently, the privileged process in pdsh is only used to serve reserved
ports to threads that need it (e.g. rsh, qsh), while allowing all threads
to still run as the "user" to support ssh and mrsh. This is *not*
a security enhancement, and doesn't make installing pdsh setuid root
any more secure.
-- (ssh) Allow arguments to ssh command to be overridden and augmented
with environment variables PDSH_SSH_ARGS and PDSH_SSH_ARGS_APPEND.
-- Fix for race condition in ssh support which caused occasional pdsh
hang, especially when running with a larger fanout.
-- Fix for ``-x hosts'' processing bug: occasionally hosts provided to
-x option would not be removed from the list of targets because the
list of excluded hosts was being processed too early.
-- Fixes for Mac OSX support: Update libtool/ltmain.sh and test for
and include sys/uio.h.
-- Add support for LANL XCPU.
* Changes in pdsh-2.8 (2005-10-13)
===================================
-- (dshgroup) Fix bug in dshgroup module which resulted in the module
trying to read only from ~/.dsh/group/ even if /etc/dsh/group/
should have been used. (patch from Joe Ramey <ramey@it.com>)
-- Print error strings returned by remote RCP server instead of generic
"Failed to initiate RCP protocol."
-- Allow hostlist expressions to have suffixes (e.g. foo[0-10]-bar).
-- Fix for command timeout when its value is less than connect timeout.
-- (ssh) Remove ssh_reaper thread and instead reap child ssh processes
within each thread spawned by pdsh. This fixes reported problem
under LinuxThreads.
-- (sdr) Fix assertion failure if host_responds info exists in SDR
for a node number that doesn't exist in Node class.
* Changes in pdsh-2.7 (2005-08-15)
===================================
-- Add dshgroup module which adds -g/-X groupname to utilize dsh-style
"group" files in ~/.dsh/group/groupname || /etc/dsh/group/groupname.
-- Fix possible truncation of output when poll() returns POLLHUP before
all data has been read.
-- Close pdsh file descriptors opened to ssh commands before invoking
subsequent ssh connections to fix possible pdsh hang with -Rssh.
-- Replace setenv() & seteuid() with putenv() & setuid() for portability.
-- Module path elements now considered secure if they have same ownership
as pdsh binary (as well as either root or current user). Allows pdsh
to be installed with other than root ownership.
* Changes in pdsh-2.6 (2005-08-02)
===================================
-- (ssh) Fix pdcp hang with ssh on HP-UX (and possibly other systems).
(Yehia Beyh <Yehia.Beyh@hp.com>)
-- Remove pdcp debugging code released with pdsh-2.5.
* Changes in pdsh-2.5 (2005-07-21)
===================================
-- (ssh) Added ssh "reaper" thread to collect exit status of ssh commands
invoked by pdsh. At the end of the pdsh or pdcp run, any non-zero
exit status from ssh will be written to stderr instead of silently
ignored.
-- (genders) Added genders "query" support for genders versions that
support this functionality. (Al Chu <chu11@llnl.gov>)
-- (ssh) Fix for a possible pdsh hang when running with ssh on Mac OS X.
-- (qshell) Fix for m/qshd failure on nodes without an elan3 adapter.
(Daniel Blueman <daniel.blueman@quadrics.com>)
-- Update path to xinetd script in pdsh specfile (Daniel Blueman).
-- Don't increase number of open files rlimit until after rcmd modules
are initialized in case rcmd module increases fanout.
-- Don't consider directory permissions insecure when other has write
access if the sticky bit is set.
* Changes in pdsh-2.4 (2004-12-08)
===================================
-- (mrsh) Update to mrsh protocol version 2.1, provided by mrsh >= 2.3.
This version of the protocol allows connections over "localhost."
* Changes in pdsh-2.3 (2004-11-22)
===================================
-- Support copying files >2GB in pdcp.
-- Increase max number of open files to the hard limit if
a large fanout is requested.
* Changes in pdsh-2.2 (2004-07-30)
===================================
-- Do not abort when excluded hosts are not within the target list.
-- (slurm) Allow multiple SLURM jobids to be passed to -j option.
* Changes in pdsh-2.1 (2004-06-09)
===================================
-- Fix dshbak script to allow whitespace in hostname "tags"
(Ashley Pittman <ashley@quadrics.com>).
-- Fix broken QsNet support on Elan3 systems without libelanctrl.
-- Explicitly set thread stack size to 128K to avoid arbitrarily
large stack set from current rlimit under Linux/NPTL.
* Changes in pdsh-2.0 (2004-05-26)
===================================
-- Reorganized pdsh source tree.
-- Modularized pdsh functionality into dynamic runtime "modules."
- Moved remote command api (e.g. rsh, ssh, etc.) into "rcmd" modules.
- New pdsh option `-R' for selection of rcmd type at runtime.
- All other optional functionality moved into "misc" modules (e.g. genders).
- See README.modules in pdsh distribution for more information.
-- Package core pdsh functionality and pdsh modules separately in order to
make pdsh installation much more flexible.
-- Removed pdsh dependency on rcp. Rcp server code used by pdsh is now
coded directly into pdcp. (Note: This means pdcp *must* be installed
on all target nodes)
-- Added mrsh and mqshell client modules, as well as mqshd server for Munge
authenticated rcmd() support.
-- Added SLURM module to build list of targets from SLURM allocations.
-- (genders) Added "-X" option to exclude targets based on genders attributes.
-- (genders) Multiple attributes may now be passed to "-g" and "-X."
-- (genders) "-a" renamed to "-A" -- "-a" now skips any nodes in genders
database with "pdsh_all_skip" attribute.
-- (genders) New "-F" option to specify non-default genders file.
-- QsNet support now requires "/etc/elanhosts" config file (see README.QsNet).
-- QsNet support includes support for QSW elanctrl interface. (Elan3/Elan4)
-- Added support for running Elan network error resolver thread in qshd/mqshd.
(Elan3 only)
-- Nominal support for Elan multirail jobs (largely untested). See
qshell and mqshell `-r railmask' option.
$Id$
