Life with Open Source

commit   : a8590c9aded9a6603eb0ed64ac1a5792f700e22e    
  
author   : David Steele <david@pgmasters.net>    
date     : Wed, 7 Sep 2016 08:29:21 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Wed, 7 Sep 2016 08:29:21 -0400    

Bug Fixes:  
  
* Fixed an issue where tablespaces were copied from the master during standby backup.  
* Fixed the check command so backup info is checked remotely and not just locally. (Fixed by Cynthia Shang.)  
* Fixed an issue where retention-archive was not automatically being set when retention-archive-type=diff, resulting in a less aggressive than intended expiration of archive. (Fixed by Cynthia Shang.)  
  
Features:  
  
* Converted Perl threads to processes to improve compatibility and performance.  
* Exclude contents of $PGDATA/pg_replslot directory so that replication slots on the master do not become part of the backup.  
* The archive-start and archive-stop settings are now filled in backup.manifest even when archive-check=n.  
* Additional warnings when archive retention settings may not have the intended effect or would allow indefinite retention. (Contributed by Cynthia Shang.)  
* Experimental support for non-exclusive backups in PostgreSQL 9.6 rc1. Changes to the control/catalog/WAL versions in subsequent release candidates may break compatibility but pgBackRest will be updated with each release to keep pace.  
  
Refactoring:  
  
* Refactor of protocol minions in preparation for the new local minion.  
* Remove obsolete thread index variable from File() module.  
* Changed temporary file names to consistently use the .pgbackrest.tmp extension even if the destination file is compressed or has an appended checksum.  
* Improve ASSERT error handling, safely check eval blocks, and convert $@ to $EVAL_ERROR.  

commit   : be77136eaeca4d0943bd00280afcbe3f5a53a096    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 25 Aug 2016 11:49:09 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 25 Aug 2016 11:49:09 -0400    

Bug Fixes:  
  
* Fixed an issue where a tablespace link that referenced another link would not produce an error, but instead skip the tablespace entirely. (Reported by Michael Vitale.)  
* Fixed an issue where options that should not allow multiple values could be specified multiple times in pgbackrest.conf without an error being raised. (Reported by Michael Vitale.)  
* Fixed an issue where the protocol-timeout option was not automatically increased when the db-timeout option was increased. (Reported by Todd Vernick.)  
  
Features:  
  
* Backup from a standby cluster. A connection to the primary cluster is still required to start/stop the backup and copy files that are not replicated, but the vast majority of files are copied from the standby in order to reduce load on the master.  
* More flexible configuration for databases. Master and standby can both be configured on the backup server and pgBackRest will automatically determine which is the master. This means no configuration changes for backup are required after failing over from a master to standby when a separate backup server is used.  
* Exclude directories during backup that are cleaned, recreated, or zeroed by PostgreSQL at startup. These include pgsql_tmp and pg_stat_tmp. The postgresql.auto.conf.tmp file is now excluded in addition to files that were already excluded: backup_label.old, postmaster.opts, postmaster.pid, recovery.conf, recovery.done.  
* Experimental support for non-exclusive backups in PostgreSQL 9.6 beta4. Changes to the control/catalog/WAL versions in subsequent betas may break compatibility but pgBackRest will be updated with each release to keep pace.  
  
Refactoring:  
  
* Simplify protocol creation and identifying which host is local/remote.  
* Removed all OP_* function constants that were used only for debugging, not in the protocol, and replaced with __PACKAGE__.  
* Improvements in Db module: separated out connect() function, allow executeSql() calls that do not return data, and improve error handling.  
* Improve error message for links that reference links in manifest build.  
* Added hints to error message when relative paths are detected in archive-push or archive-get.  
* Improve backup log messages to indicate which host the files are being copied from.  

commit   : 9f19e13095628bf1b654db08ea3eec883c2cc5cd    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 9 Aug 2016 10:06:21 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 9 Aug 2016 10:06:21 -0400    

Bug Fixes:  
  
* Fixed an issue where tablespace paths that had $PGDATA as a substring would be identified as a subdirectories of $PGDATA even when they were not. Also hardened relative path checking a bit. (Reported by Chris Fort.)  

commit   : cb5b88af7dc7529dcdfd8c0ff71c5372877b7f19    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:35:15 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:35:15 -0400    

commit   : 6bb96c0a0699444ead4746e483fd56de3be5539c    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:11 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:11 -0400    

commit   : 01de6f3fd80721583baf2378ee8fe2b06a448ed0    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:33:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:33:27 -0400    

commit   : c5081941f921bd342529b255ed2af1adccc253ed    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    

commit   : 757f567ec8d6d4767e74cf987a5cc63e63f1c9dc    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:31:43 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:31:43 -0400    

commit   : 43957e873d22ce5d279a91d3acda6fc9e848fda7    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    

commit   : 860f8fb1aa4ee01259bac8fa4e1c4da9570ac1b7    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:29:39 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:29:39 -0400    

commit   : cf21e6f7e9448b9f0964e9864f570ade9d672496    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    

commit   : eb4dfa239e6f54fef5c486caf4b58a9805c19572    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:27:53 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 16:27:53 -0400    

commit   : 2183966c6d00a16cc307f8563da469b14ed07b6f    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 8 Aug 2016 11:56:10 -0400    

commit   : 277934447b0f4602260978ecb12d2e3d580632df    
  
author   : David Steele <david@pgmasters.net>    
date     : Sat, 30 Jul 2016 09:42:35 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sat, 30 Jul 2016 09:42:35 -0400    

Bug Fixes:  
  
* Fixed an issue an where an extraneous remote was created causing threaded backup/restore to possibly timeout and/or throw a lock conflict. (Reported by Michael Vitale.)  
* Fixed an issue where db-path was not required for the check command so an assert was raised when it was missing rather than a polite error message. (Reported by Michael Vitale.)  
* Fixed check command to throw an error when database version/id does not match that of the archive. (Fixed by Cynthia Shang.)  
* Fixed an issue where a remote could try to start its own remote when the backup-host option was not present in pgbackrest.conf on the database server. (Reported by Lardière Sébastien.)  
* Fixed an issue where the contents of pg_xlog were being backed up if the directory was symlinked. This didn't cause any issues during restore but was a waste of space.  
* Fixed an invalid log() call in lock routines.  
  
Features:  
  
* Experimental support for non-exclusive backups in PostgreSQL 9.6 beta3. Changes to the control/catalog/WAL versions in subsequent betas may break compatibility but pgBackRest will be updated with each release to keep pace.  
  
Refactoring:  
  
* Enhancements to the protocol layer for improved reliability and error handling.  
* All remote types now take locks. The exceptions date to when the test harness and pgBackRest were running in the same VM and no longer apply.  
* Exceptions are now passed back from threads as messages when possible rather than raised directly.  
* Temp files created during backup are now placed in the same directory as the target file.  
* Output lock file name when a lock cannot be acquired to aid in debugging.  
* Reduce calls to protocolGet() in backup/restore.  
* Suppress banners on SSH protocol connections.  
* Improved remote error messages to identify the host where the error was raised.  

commit   : 1b62354dcb6cd815fc8a5b235b0aaf52eb85a692    
  
author   : David Steele <david@pgmasters.net>    
date     : Sat, 2 Jul 2016 10:22:52 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sat, 2 Jul 2016 10:22:52 -0400    

Bug Fixes:  
  
* Fixed an issue where keep-alives could be starved out by lots of small files during multi-threaded backup. They were also completely absent from single/multi-threaded backup resume and restore checksumming. (Reported by Janice Parkinson, Chris Barber.)  
* Fixed an issue where the expire command would refuse to run when explicitly called from the command line if the db-host option was set. This was not an issue when expire was run automatically after a backup (Reported by Chris Barber.)  
* Fixed an issue where validation was being running on archive_command even when the archive-check option was disabled.  
  
Features:  
  
* Added check command to validate that pgBackRest is configured correctly for archiving and backups. (Contributed by Cynthia Shang.)  
* Added the protocol-timeout option. Previously protocol-timeout was set as db-timeout + 30 seconds.  
* Failure to shutdown remotes at the end of the backup no longer throws an exception. Instead a warning is generated that recommends a higher protocol-timeout.  
* Experimental support for non-exclusive backups in PostgreSQL 9.6 beta2. Changes to the control/catalog/WAL versions in subsequent betas may break compatibility but pgBackRest will be updated with each release to keep pace.  
  
Refactoring:  
  
* The pg_xlogfile_name() function is no longer used to construct WAL filenames from LSNs. While this function is convenient it is not available on a standby. Instead, the archive is searched for the LSN in order to find the timeline. If due to some misadventure the LSN appears on multiple timelines then an error will be thrown, whereas before this condition would have passed unnoticed.  
* Option handling is now far more strict. Previously it was possible for a command to use an option that was not explicitly assigned to it. This was especially true for the backup-host and db-host options which are used to determine locality.  
* Improved handling of users/groups captured during backup that do not exist on the restore host. Also explicitly handle the case where user/group is not mapped to a name.  
* Changed version variable to a constant. It had originally been designed to play nice with a specific packaging tool but that tool was never used.  

commit   : 1c99eb969d28e950f8a236bc066aceac169bdc3a    
  
author   : Joe Conway <mail@joeconway.com>    
date     : Tue, 14 Jun 2016 09:24:46 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 14 Jun 2016 09:24:46 -0400    

IsUnderPostmaster behaves differently under Windows than it does under Linux. Instead use  
process_shared_preload_libraries_in_progress to determine if pgaudit is being loaded by shared_preload_libraries.  

commit   : a91f29388bdec6346e80fd596957659087706ac2    
  
author   : crunchyjohn <crunchyjohn@users.noreply.github.com>    
date     : Fri, 10 Jun 2016 14:48:42 -0400    
  
committer: David Steele <dwsteele@users.noreply.github.com>    
date     : Fri, 10 Jun 2016 14:48:42 -0400    

commit   : 2a989ac3732d9486c84f287a84da44d33c8a0892    
  
author   : David Steele <david@pgmasters.net>    
date     : Sat, 4 Jun 2016 11:30:47 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sat, 4 Jun 2016 11:30:47 -0400    

commit   : bfaee7380d6aa0a4a4573df2a6a28581537d169b    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 2 Jun 2016 11:10:24 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 2 Jun 2016 11:10:24 -0400    

* Fix usage of sprintf() due to new constraints in Perl 5.22. Parameters not referenced in the format string are no longer allowed. (Fixed by Adrian Vondendriesch.)  

commit   : 26a7781f3ff223073867252210c0448c26df8547    
  
author   : David Steele <david@crunchydata.com>    
date     : Wed, 1 Jun 2016 10:44:53 -0400    
  
committer: David Steele <david@crunchydata.com>    
date     : Wed, 1 Jun 2016 10:44:53 -0400    

commit   : 8cae59f3acd4a4d4e1f810e012002af960c86a31    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 31 May 2016 20:47:19 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 31 May 2016 20:47:19 -0400    

commit   : b710c016302d8d29c502aab5688197bf9a664131    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 17 May 2016 01:04:01 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 17 May 2016 01:04:01 -0400    

* Enhanced text output of `info` command to include timestamps, sizes, and the reference list for all backups. Contributed by Cynthia Shang.  
  
* Allow selective restore of databases from a cluster backup. This feature can result in major space and time savings when only specific databases are restored. Unrestored databases will not be accessible but must be manually dropped before they will be removed from the shared catalogue.  
  
* Experimental support for non-exclusive backups in PostgreSQL 9.6 beta1. Changes to the control/catalog/WAL versions in subsequent betas may break compatibility but pgBackRest will be updated with each release to keep pace.  

commit   : ddb0843d44a53518cfbbb5c2fd535021d75d07cd    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:57:25 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:57:25 -0400    

commit   : e712933c80a15719293f0c55eeb02e0aae401820    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:10:35 -0400    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:10:35 -0400    

commit   : e9dca8ce147f32d7d64a9e64f9d8339310ad6535    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:56:07 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:56:07 -0400    

commit   : 3ad64ae4dadc56b756cb50845963c13ceb85d33f    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:09:45 -0400    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:09:45 -0400    

commit   : cd5a6521fa8e9d51090330eb500157079fda1381    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:53:56 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:53:56 -0400    

commit   : b81b97794cc81780105024667766d2f2f63fc62e    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:08:57 -0400    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:08:57 -0400    

commit   : d130536e93378d9b6512d268639324ba7f60a815    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:52:03 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:52:03 -0400    

commit   : c20dd81034ebeed38a372e3696dfe12550a26ce4    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:06:37 -0400    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:06:37 -0400    

commit   : ba37ac217791dfdf2b327c4b75e7083b6b03a2f5    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:50:23 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 9 May 2016 16:50:23 -0400    

commit   : e51547e05a44101667ef277c89319647e52c0f62    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:05:46 -0400    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 9 May 2016 10:05:46 -0400    

commit   : 506ed71d906f875328b92d5bcf589047f322ff0f    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 5 May 2016 15:25:16 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 5 May 2016 15:25:16 -0400    

Note that all text in the statement after the "password" token is redacted so non-password related clauses will also be redacted when they follow the "password" token.  

commit   : 9ab0dd80f70cc69a6edc9e61b6053752a789fde3    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 14 Apr 2016 23:04:20 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 14 Apr 2016 23:04:20 -0400    

* This flag day release breaks compatibility with older versions of pgBackRest. The manifest format, on-disk structure, configuration scheme, and the exe/path names have all changed. You must create a new repository to hold backups for this version of pgBackRest and keep your older repository for a time in case you need to do a restore. Restores from the prior repository will require the prior version of pgBackRest but because of name changes it is possible to have 1.00 and a prior version of pgBackRest installed at the same time. See the notes below for more detailed information on what has changed.  
  
* Implemented a new configuration scheme which should be far simpler to use. See the User Guide and Configuration Reference for details but for a simple configuration all options can now be placed in the stanza section. Options that are shared between stanzas can be placed in the [global] section. More complex configurations can still make use of command sections though this should be a rare use case.  
  
* The repo-path option now always refers to the repository where backups and archive are stored, whether local or remote, so the repo-remote-path option has been removed. The new spool-path option can be used to define a location for queueing WAL segments when archiving asynchronously. A local repository is no longer required.  
  
* The default configuration filename is now pgbackrest.conf instead of pg_backrest.conf. This was done for consistency with other naming changes but also to prevent old config files from being loaded accidentally when migrating to 1.00.  
  
* The default repository name was changed from /var/lib/backup to /var/lib/pgbackrest.  
  
* Lock files are now stored in /tmp/pgbackrest by default. These days /run/pgbackrest is the preferred location but that would require init scripts which are not part of this release. The lock-path option can be used to configure the lock directory.  
  
* Log files are now stored in /var/log/pgbackrest by default and no longer have the date appended so they can be managed with logrotate. The log-path option can be used to configure the lock directory.  
  
* Executable filename changed from pg_backrest to pgbackrest.  
  
* All files and directories linked from PGDATA are now included in the backup. By default links will be restored directly into PGDATA as files or directories. The --link-all option can be used to restore all links to their original locations. The --link-map option can be used to remap a link to a new location.  
  
* Removed --tablespace option and replaced with --tablespace-map-all option which should more clearly indicate its function.  
  
* Added detail log level which will output more information than info without being as verbose as debug.  

commit   : 3296ceff06d06ab95ea4285e40503509c17a3cec    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 29 Mar 2016 21:38:54 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 29 Mar 2016 21:38:54 -0400    

This was happening because pgaudit.log was set before CREATE EXTENSION was called.  This caused an issue where pgaudit was trying to log itself being created which won't work properly with event triggers.  Documented that pgaudit.log must not be set when the pgaudit extension is created.  

commit   : 158a0fb254578e93cec7a940c780426217b79343    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 28 Mar 2016 16:16:20 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 28 Mar 2016 16:16:20 -0400    

commit   : 83b228a0babbbd637e830796a670a18a468732d5    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 28 Mar 2016 08:52:41 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 28 Mar 2016 08:52:41 +0200    

commit   : 4edcd5f5d23c55f60d6c11451437437611731fff    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 28 Mar 2016 16:14:18 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 28 Mar 2016 16:14:18 -0400    

commit   : 190e273416968205db5110a561f5a314ad4b0119    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 28 Mar 2016 08:51:44 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 28 Mar 2016 08:51:44 +0200