Life with Open Source

commit   : ca3489e768990e32096f0f24d46d5f0b8b70cff4    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:07:43 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:07:43 -0400    

commit   : d275672f7d9ad12b882687debeed549ab5ad0251    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:44:29 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:44:29 +0200    

commit   : 4191e37a9a1fb598267c445c717914012d9bc423    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:05:31 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:05:31 -0400    

commit   : 4ae11214238b382242c038566e5da970fbdaa355    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 20:03:55 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 20:03:55 +0200    

commit   : a8143ec1253f3d9187c053def0b8c515d4f13fd5    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 20:16:41 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 20:16:41 -0400    

IMPORTANT NOTE: This release fixes a critical bug in the backup resume feature. All resumed backups prior to this release should be considered inconsistent. A backup will be resumed after a prior backup fails, unless resume=n has been specified. A resumed backup can be identified by checking the backup log for the message "aborted backup of same type exists, will be cleaned to remove invalid files and resumed". If the message exists, do not use this backup or any backup in the same set for a restore and check the restore logs to see if a resumed backup was restored. If so, there may be inconsistent data in the cluster.  
  
Bug Fixes:  
  
* Fix critical bug in resume that resulted in inconsistent backups. A regression in v0.82 removed the timestamp comparison when deciding which files from the aborted backup to keep on resume. See note above for more details. (Reported by David Youatt, Yogesh Sharma, Stephen Frost.)  
* Fix error in selective restore when only one user database exists in the cluster. (Fixed by Cynthia Shang. Reported by Nj Baliyan.)  
* Fix non-compliant ISO-8601 timestamp format in S3 authorization headers. AWS and some gateways were tolerant of space rather than zero-padded hours while others were not. (Fixed by Andrew Schwartz.)  
  
Features:  
  
* PostgreSQL 11 Beta 2 support.  
  
Improvements:  
  
* Improve the HTTP client to set content-length to 0 when not specified by the server. S3 (and gateways) always set content-length or transfer-encoding but HTTP 1.1 does not require it and proxies (e.g. HAProxy) may not include either. (Suggested by Adam K. Sumner.)  
* Set search_path = 'pg_catalog' on PostgreSQL connections. (Suggested by Stephen Frost.)  

commit   : f738d268fec21cb697eb460b82240f2c2b0833f5    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 18:36:34 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 18:36:34 -0400    

IMPORTANT NOTE: This release fixes a critical bug in the backup resume feature. All resumed backups prior to this release should be considered inconsistent. A backup will be resumed after a prior backup fails, unless resume=n has been specified. A resumed backup can be identified by checking the backup log for the message "aborted backup of same type exists, will be cleaned to remove invalid files and resumed". If the message exists, do not use this backup or any backup in the same set for a restore and check the restore logs to see if a resumed backup was restored. If so, there may be inconsistent data in the cluster.  
  
Bug Fixes:  
  
* Fix critical bug in resume that resulted in inconsistent backups. A regression in v0.82 removed the timestamp comparison when deciding which files from the aborted backup to keep on resume. See note above for more details. (Reported by David Youatt, Yogesh Sharma, Stephen Frost.)  
* Fix non-compliant ISO-8601 timestamp format in S3 authorization headers. AWS and some gateways were tolerant of space rather than zero-padded hours while others were not. (Fixed by Andrew Schwartz.)  
* Fix directory syncs running recursively when only the specified directory should be synced. (Reported by Craig A. James.)  
* Fix --target-action and --recovery-option options being reported as invalid when restoring with --type=immediate. (Reported by Brad Nicholson.)  
* Fix archive-copy throwing "path not found" error for incr/diff backups. (Reported by yummyliu, Vitaliy Kukharik.)  
* Fix failure in manifest build when two or more files in PGDATA are linked to the same directory. (Reported by Vitaliy Kukharik.)  
* Fix delta restore failing when a linked file was missing.  
* Fix error in selective restore when only one user database exists in the cluster. (Fixed by Cynthia Shang. Reported by Nj Baliyan.)  
  
Improvements:  
  
* Improve the HTTP client to set content-length to 0 when not specified by the server. S3 (and gateways) always set content-length or transfer-encoding but HTTP 1.1 does not require it and proxies (e.g. HAProxy) may not include either. (Suggested by Adam K. Sumner.)  
* Improve performance of HTTPS client. Buffering now takes the pending bytes on the socket into account (when present) rather than relying entirely on select(). In some instances the final bytes would not be flushed until the connection was closed.  
* Improve S3 delete performance. The constant S3_BATCH_MAX had been replaced with a hard-coded value of 2, probably during testing.  
* Make backup/restore path sync more efficient. Scanning the entire directory can be very expensive if there are a lot of small tables. The backup manifest contains the path list so use it to perform syncs instead of scanning the backup/restore path. Remove recursive path sync functionality since it is no longer used.  

commit   : f7123c1bbf239814b33ddc97e53b472cf0e69d16    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 22 May 2018 19:53:25 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 22 May 2018 19:53:25 -0400    

Bug Fixes:  
  
* Fix potential buffer overrun in error message handling. (Reported by Lætitia.)  
* Fix archive write lock being taken for the synchronous archive-get command. (Reported by Uspen.)  
  
Improvements:  
  
* Embed exported C functions and Perl modules directly into the pgBackRest executable.  
* Use time_t instead of __time_t for better portability. (Suggested by Nick Floersch.)  
* Print total runtime in milliseconds at command end.  

commit   : ec8e7d60bac23b1b9102798afc30078aca9076ae    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:59:47 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:59:47 -0400    

commit   : 035524b11821343bf1236e8ea5b078b9508225df    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : 364998df87a8fc498302d4b02681909f81635914    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:57:35 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:57:35 -0400    

commit   : d289dcfc393c5329fb67a1df27957a9923365ce6    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : ceb2b0b0abaf0e7a14d25c3e75d4fd0b80714149    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:55:28 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:55:28 -0400    

commit   : 23a086a03fe635764c8f0879219a7adeb5a39b56    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : 2f895f784fb31bf008162e9c52cc0b2c717823e8    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:53:38 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:53:38 -0400    

commit   : e71d9f6951fa61f386bebe3c97735a80def8a1e2    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : ab5e9caa4a3ec4765348a0482e88edcf3f6aab4a    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:51:40 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:51:40 -0400    

commit   : f5f8b5892a08c678de878653fca906f85e399f27    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : ee8aafb3cadd77682c97bcc74adb457e0723ebee    
  
author   : David Steele <david@pgmasters.net>    
date     : Sun, 6 May 2018 19:53:42 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sun, 6 May 2018 19:53:42 -0400    

Bug Fixes:  
  
* Fix directory syncs running recursively when only the specified directory should be synced. (Reported by Craig A. James.)  
* Fix archive-copy throwing "path not found" error for incr/diff backups. (Reported by yummyliu, Vitaliy Kukharik.)  
* Fix failure in manifest build when two or more files in PGDATA are linked to the same directory. (Reported by Vitaliy Kukharik.)  
* Fix delta restore failing when a linked file is missing.  
* Fix rendering of key/value and list options in help. (Reported by Clinton Adams.)  
  
Features:  
  
* Add asynchronous, parallel archive-get. This feature maintains a queue of WAL segments to help reduce latency when PostgreSQL requests a WAL segment with restore_command.  
* Add support for additional pgBackRest configuration files in the directory specified by the --config-include-path option. Add --config-path option for overriding the default base path of the --config and --config-include-path option. (Contributed by Cynthia Shang.)  
* Add repo-s3-token option to allow temporary credentials tokens to be configured. pgBackRest currently has no way to request new credentials so the entire command (e.g. backup, restore) must complete before the credentials expire. (Contributed by Yogesh Sharma.)  
  
Improvements:  
  
* Update the archive-push-queue-max, manifest-save-threshold, and buffer-size options to accept values in KB, MB, GB, TB, or PB where the multiplier is a power of 1024. (Contributed by Cynthia Shang.)  
* Make backup/restore path sync more efficient. Scanning the entire directory can be very expensive if there are a lot of small tables. The backup manifest contains the path list so use it to perform syncs instead of scanning the backup/restore path.  
* Show command parameters as well as command options in initial info log message.  
* Rename archive-queue-max option to archive-push-queue-max to avoid confusion with the new archive-get-queue-max option. The old option name will continue to be accepted.  

commit   : 2a3d6ecde8a86154cfaba067dfcbe459ef2aa8e1    
  
author   : David Steele <david@pgmasters.net>    
date     : Mon, 19 Mar 2018 21:49:41 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Mon, 19 Mar 2018 21:49:41 -0400    

Bug Fixes:  
  
* Fix --target-action and --recovery-option options being reported as invalid when restoring with --type=immediate. (Reported by Brad Nicholson.)  
* Immediately error when a secure option (e.g. repo1-s3-key) is passed on the command line. Since pgBackRest would not pass secure options on to sub-processes an obscure error was thrown. The new error is much clearer and provides hints about how to fix the problem. Update command documentation to omit secure options that cannot be specified on the command-line. (Reported by Brad Nicholson.)  
* Fix issue passing --no-config to embedded Perl. (Reported by Ibrahim Edib Kokdemir.)  
* Fix issue where specifying log-level-stderr > warn would cause a local/remote process to error on exit due to output found on stderr when none was expected. The max value for a local/remote process is now error since there is no reason for these processes to emit warnings. (Reported by Clinton Adams.)  
* Fix manifest test in the check command when tablespaces are present. (Fixed by Cynthia Shang. Reported by Thomas Flatley.)  
  
Improvements:  
  
* Error when multiple arguments are set in the config file for an option that does not accept multiple arguments. (Contributed by Cynthia Shang.)  
* Remove extraneous sudo commands from src/Makefile. (Contributed by Adrian Vondendriesch.)  

commit   : 3652766ba932c7b7efdb2b29524898d881a94a33    
  
author   : Magnus Hagander <magnus@hagander.net>    
date     : Tue, 27 Feb 2018 14:08:53 +0100    
  
committer: Magnus Hagander <magnus@hagander.net>    
date     : Tue, 27 Feb 2018 14:08:53 +0100    

The Makefile portion of 91f3ffc5249eff99c311fb27e7b29a44d9c62be1 broke  
the MSVC build. This patch reverts the changes to the Makefile and  
adjusts it to work with the new code, while keeping the actual code  
changes from the original patch.  
  
Author: Victor Wagner <vitus@wagner.pp.ru>  

commit   : 5181bebba73b2fdcb38f4c7f06491e8092873969    
  
author   : Magnus Hagander <magnus@hagander.net>    
date     : Tue, 27 Feb 2018 14:08:53 +0100    
  
committer: Magnus Hagander <magnus@hagander.net>    
date     : Tue, 27 Feb 2018 14:08:53 +0100    

The Makefile portion of 91f3ffc5249eff99c311fb27e7b29a44d9c62be1 broke  
the MSVC build. This patch reverts the changes to the Makefile and  
adjusts it to work with the new code, while keeping the actual code  
changes from the original patch.  
  
Author: Victor Wagner <vitus@wagner.pp.ru>  

commit   : 41545d1524eb461b91698f53316b556c96aaf3a5    
  
author   : Magnus Hagander <magnus@hagander.net>    
date     : Tue, 27 Feb 2018 14:08:53 +0100    
  
committer: Magnus Hagander <magnus@hagander.net>    
date     : Tue, 27 Feb 2018 14:08:53 +0100    

The Makefile portion of 91f3ffc5249eff99c311fb27e7b29a44d9c62be1 broke  
the MSVC build. This patch reverts the changes to the Makefile and  
adjusts it to work with the new code, while keeping the actual code  
changes from the original patch.  
  
Author: Victor Wagner <vitus@wagner.pp.ru>  

commit   : ad5fe2d22d020a439e96d476c65eb43885338d86    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 17:13:40 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 17:13:40 -0500    

commit   : 3300e876cd45cf169d981fa53f9c9e8289ee3c82    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 12:22:39 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 12:22:39 -0500    

commit   : 65c6b53991e1c56f6a0700ae26928962ddf2b9fe    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 17:10:47 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 17:10:47 -0500    

commit   : fdf521d697a37fbaa283e7b9de3ffc7f5029f544    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 12:22:39 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 26 Feb 2018 12:22:39 -0500    

commit   : 13cdb75ac56609c6a1d2f7cb3c31c0f0b29ecc3b    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 23 Feb 2018 22:38:45 -0500    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 23 Feb 2018 22:38:45 -0500    

Features:  
  
* The archive-push command is now partially coded in C which allows the PostgreSQL archive_command to run significantly faster when processing status messages from the asynchronous archive process. (Reviewed by Cynthia Shang.)  
  
Improvements:  
  
* Improve check command to verify that the backup manifest can be built. (Contributed by Cynthia Shang.)  
* Improve performance of HTTPS client. Buffering now takes the pending bytes on the socket into account (when present) rather than relying entirely on select(). In some instances the final bytes would not be flushed until the connection was closed.  
* Improve S3 delete performance. The constant S3_BATCH_MAX had been replaced with a hard-coded value of 2, probably during testing.  
* Allow any non-command-line option to be reset to default on the command-line. This allows options in pgbackrest.conf to be reset to default which reduces the need to write new configuration files for specific needs.  
* The C library is now required. This eliminates conditional loading and eases development of new library features.  
* The pgbackrest executable is now a C binary instead of Perl. This allows certain time-critical commands (like async archive-push) to run more quickly.  
* Rename db-* options to pg-* and backup-* options to repo-* to improve consistency. repo-* options are now indexed although currently only one is allowed.  

commit   : 0a0ee721f8190f8e6e633aa959bf9801932bd361    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:08:57 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:08:57 -0500    

commit   : 01b2db1cd6673a94cc5249aa25b34e7d98535c11    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:41 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:41 -0500    

commit   : b7e1ca7d8e65319cc325bdbc757e723ce5b02937    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:07:03 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:07:03 -0500    

commit   : 9a12ac37be9683da09c3dc33d0ee43728ca49517    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    

commit   : b2be11138b4532c9ce4d7e9d795547b162e8abd5    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:05:21 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:05:21 -0500    

commit   : 2a08ab38d33021d92d8ee31d9e386da63c39424d    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    

commit   : 799107108b36ca3ef498bf5997626f5fc43cabb0    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:03:36 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:03:36 -0500    

commit   : 0ba3e3ec8166907df835895279bb9b832f6ae348    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    

commit   : 2840d201c6a62beb86d9671a66eeec56183d261b    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:01:02 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 16:01:02 -0500    

commit   : cbe0dd581e7c7a815f6df6d849449225c902b17c    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Feb 2018 14:43:40 -0500    

commit   : 63cb94dc7631e7fac36543292d893c340a161537    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 1 Feb 2018 17:01:01 -0500    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 1 Feb 2018 17:01:01 -0500    

Bug Fixes:  
  
* Fixed inability to restore a single database contained in a tablespace using --db-include. (Fixed by Cynthia Shang.)  
* Ensure latest db-id is selected on when matching archive.info to backup.info. This provides correct matching in the event there are system-id and db-version duplicates (e.g. after reverting a pg_upgrade). (Fixed by Cynthia Shang. Reported by Adam K. Sumner.)  
* Fixed overly chatty error message when reporting an invalid command. (Reported by Jason O'Donnell.)  
  
Features:  
  
* Add stanza-delete command to cleanup unused stanzas. (Contributed by Cynthia Shang. Suggested by Magnus Hagander.)  
  
Improvements:  
  
* Improve stanza-create command so that it does not error when the stanza already exists. (Contributed by Cynthia Shang.)  

commit   : 103dcee0c541cb524e4928e8da50c14d154d1c6e    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 19 Dec 2017 18:46:44 -0500    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 19 Dec 2017 18:46:44 -0500    

Bug Fixes:  
  
* Fixed an issue that suppressed locality errors for backup and restore. When a backup host is present, backups should only be allowed on the backup host and restores should only be allowed on the database host unless an alternate configuration is created that ignores the remote host. (Reported by Lardière Sébastien.)  
* Fixed an issue where WAL was not expired on PostgreSQL 10. This was caused by a faulty regex that expected all PostgreSQL major versions to be X.X. (Reported by Adam Brusselback.)  
* Fixed an issue where the --no-config option was not passed to child processes. This meant the child processes would still read the local config file and possibly cause unexpected behaviors.  
* Fixed info command to eliminate "db (prior)" output if no backups or archives exist for a prior version of the cluster. (Fixed by Cynthia Shang. Reported by Stephen Frost.)