Life with Open Source

commit   : d06fe6ce2c79420fd19ac89ace81b66579f08493    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Tue, 6 Nov 2018 18:56:26 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Tue, 6 Nov 2018 18:56:26 -0500    

Add entries for v11 changes that went in post-stamping, but before  
the final wrap.  

commit   : c10bb239d29017ba66eca88a24b84a1d4db36a6c    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:53:28 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:53:28 -0500    

commit   : 1394a48db9db1dcc4a02739b228cebf54c4827f2    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 5 Nov 2018 15:13:49 +0100    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 5 Nov 2018 15:13:49 +0100    

commit   : 4f0bf3359faee12317808634024627a824d658f5    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:51:23 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:51:23 -0500    

commit   : b7301e3a7b6362d550727deffb0ebd06363efdba    
  
author   : Andres Freund <andres@anarazel.de>    
date     : Mon, 5 Nov 2018 12:02:25 -0800    
  
committer: Andres Freund <andres@anarazel.de>    
date     : Mon, 5 Nov 2018 12:02:25 -0800    

commit   : 0b09804544cb51e0d90c874f62a1d600ca9321d6    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:49:29 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:49:29 -0500    

commit   : a0e450e91ee9b6a79c55b5a5265147e789996549    
  
author   : Andres Freund <andres@anarazel.de>    
date     : Mon, 5 Nov 2018 12:02:25 -0800    
  
committer: Andres Freund <andres@anarazel.de>    
date     : Mon, 5 Nov 2018 12:02:25 -0800    

commit   : 518d5492911d445b126e9d5c669a83b5cae43e50    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:47:37 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:47:37 -0500    

commit   : a16e8b440132d0418d7d0c8986ac944b2370a1d4    
  
author   : Andres Freund <andres@anarazel.de>    
date     : Mon, 5 Nov 2018 12:02:25 -0800    
  
committer: Andres Freund <andres@anarazel.de>    
date     : Mon, 5 Nov 2018 12:02:25 -0800    

commit   : c63d9ebb5940bf3d24a6ecdc300ca9e95e29ddbe    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:45:50 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:45:50 -0500    

commit   : bce0ff4080eba1f7175db832227bfde84db3af31    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:07:06 -0500    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 5 Nov 2018 16:07:06 -0500    

commit   : 904550c97f674d3f576d3113756f2b5c89b55ddf    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 16 Oct 2018 14:56:51 +0100    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 16 Oct 2018 14:56:51 +0100    

Bug Fixes:  
  
* Fix missing missing URI encoding in S3 driver. (Reported by Dan Farrell.)  
* Fix incorrect error message for duplicate options in configuration files. (Reported by Jesper St John.)  
* Fix incorrectly reported error return in info logging. A return code of 1 from the archive-get was being logged as an error message at info level but otherwise worked correctly.  
  
Features:  
  
* Add checksum delta for incremental backups which uses checksums rather than timestamps to determine if files have changed. (Contributed by Cynthia Shang.)  
* PostgreSQL 11 support, including configurable WAL segment size.  
  
Improvements:  
  
* Ignore all files in a linked tablespace directory except the subdirectory for the current version of PostgreSQL. Previously an error would be generated if other files were present and not owned by the PostgreSQL user.  
* Improve info command to display the stanza cipher type. (Contributed by Cynthia Shang. Suggested by Douglas J Hunley.)  
* Improve support for special characters in filenames.  
* Allow delta option to be specified in the pgBackRest configuration file. (Contributed by Cynthia Shang.)  

commit   : 19f20081df059fef87e14c8e953669bd173dd7f1    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 15 Oct 2018 17:12:02 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 15 Oct 2018 17:12:02 -0400    

commit   : db9034bf7653fa527e2531e1a713dbbd37066a6b    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 15 Oct 2018 14:01:38 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 15 Oct 2018 14:01:38 -0400    

commit   : 1cd995f451a02e4778bed24bec6b70cbe887fd86    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 5 Oct 2018 17:24:03 +0100    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 5 Oct 2018 17:24:03 +0100    

commit   : 2bf4447543dfba9b3bfe72ecfd225a9600bf4c6b    
  
author   : David Steele <david@pgmasters.net>    
date     : Wed, 3 Oct 2018 13:07:33 +0100    
  
committer: David Steele <david@pgmasters.net>    
date     : Wed, 3 Oct 2018 13:07:33 +0100    

commit   : bc7462d86d3529712cf7c196a04f7d6f8dd8ee34    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 31 Aug 2018 13:19:43 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 31 Aug 2018 13:19:43 -0400    

Bug Fixes:  
  
* Fix issue where relative links in $PGDATA could be stored in the backup with the wrong path. This issue did not affect absolute links and relative tablespace links were caught by other checks. (Reported by Cynthia Shang.)  
* Remove incompletely implemented online option from the check command. Offline operation runs counter to the purpose of this command, which is to check if archiving and backups are working correctly. (Reported by Jason O'Donnell.)  
* Fix issue where errors raised in C were not logged when called from Perl. pgBackRest properly terminated with the correct error code but lacked an error message to aid in debugging. (Reported by Douglas J Hunley.)  
* Fix issue when a boolean option (e.g. delta) was specified more than once. (Reported by Yogesh Sharma.)  
  
Features:  
  
* Allow any option to be set in an environment variable. This includes options that previously could only be specified on the command line, e.g. stanza, and secret options that could not be specified on the command-line, e.g. repo1-s3-key-secret.  
* Exclude temporary and unlogged relation (table/index) files from backup. Implemented using the same logic as the patches adding this feature to PostgreSQL, 8694cc96 and 920a5e50. Temporary relation exclusion is enabled in PostgreSQL ≥ 9.0. Unlogged relation exclusion is enabled in PostgreSQL ≥ 9.1, where the feature was introduced. (Contributed by Cynthia Shang.)  
* Allow arbitrary directories and/or files to be excluded from a backup. Misuse of this feature can lead to inconsistent backups so read the --exclude documentation carefully before using. (Reviewed by Cynthia Shang.)  
* Add log-subprocess option to allow file logging for local and remote subprocesses.  
* PostgreSQL 11 Beta 3 support.  
  
Improvements:  
  
* Allow zero-size files in backup manifest to reference a prior manifest regardless of timestamp delta. (Contributed by Cynthia Shang.)  
* Improve asynchronous archive-get/archive-push performance by directly checking status files. (Contributed by Stephen Frost.)  
* Improve error message when a command is missing the stanza option. (Suggested by Sarah Conway.)  

commit   : e0fb7a2ce39f25cbbbe50c95aebdab1ee3beff23    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:13:40 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:13:40 -0400    

commit   : 50043c87dfaf8e554e792df15ae8ef1fc5df9632    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:30:02 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:30:02 +0200    

commit   : 895fb6e2e270654b2a89042ddaf7db0e1a29003c    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:11:24 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:11:24 -0400    

commit   : 1af8bbe9abab91b2f269cc6dddcc9b7e5350929d    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:31:39 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:31:39 +0200    

commit   : 2a37ee373aad7f8a702601b1c0bc0df6c79cff58    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:09:28 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:09:28 -0400    

commit   : 10e1a4a26cb7f849fabd0302b9aec8de9be39be7    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:35:42 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:35:42 +0200    

commit   : ca3489e768990e32096f0f24d46d5f0b8b70cff4    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:07:43 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:07:43 -0400    

commit   : d275672f7d9ad12b882687debeed549ab5ad0251    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:44:29 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 19:44:29 +0200    

commit   : 4191e37a9a1fb598267c445c717914012d9bc423    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:05:31 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 6 Aug 2018 16:05:31 -0400    

commit   : 4ae11214238b382242c038566e5da970fbdaa355    
  
author   : Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 20:03:55 +0200    
  
committer: Peter Eisentraut <peter_e@gmx.net>    
date     : Mon, 6 Aug 2018 20:03:55 +0200    

commit   : a8143ec1253f3d9187c053def0b8c515d4f13fd5    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 20:16:41 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 20:16:41 -0400    

IMPORTANT NOTE: This release fixes a critical bug in the backup resume feature. All resumed backups prior to this release should be considered inconsistent. A backup will be resumed after a prior backup fails, unless resume=n has been specified. A resumed backup can be identified by checking the backup log for the message "aborted backup of same type exists, will be cleaned to remove invalid files and resumed". If the message exists, do not use this backup or any backup in the same set for a restore and check the restore logs to see if a resumed backup was restored. If so, there may be inconsistent data in the cluster.  
  
Bug Fixes:  
  
* Fix critical bug in resume that resulted in inconsistent backups. A regression in v0.82 removed the timestamp comparison when deciding which files from the aborted backup to keep on resume. See note above for more details. (Reported by David Youatt, Yogesh Sharma, Stephen Frost.)  
* Fix error in selective restore when only one user database exists in the cluster. (Fixed by Cynthia Shang. Reported by Nj Baliyan.)  
* Fix non-compliant ISO-8601 timestamp format in S3 authorization headers. AWS and some gateways were tolerant of space rather than zero-padded hours while others were not. (Fixed by Andrew Schwartz.)  
  
Features:  
  
* PostgreSQL 11 Beta 2 support.  
  
Improvements:  
  
* Improve the HTTP client to set content-length to 0 when not specified by the server. S3 (and gateways) always set content-length or transfer-encoding but HTTP 1.1 does not require it and proxies (e.g. HAProxy) may not include either. (Suggested by Adam K. Sumner.)  
* Set search_path = 'pg_catalog' on PostgreSQL connections. (Suggested by Stephen Frost.)  

commit   : f738d268fec21cb697eb460b82240f2c2b0833f5    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 18:36:34 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 5 Jul 2018 18:36:34 -0400    

IMPORTANT NOTE: This release fixes a critical bug in the backup resume feature. All resumed backups prior to this release should be considered inconsistent. A backup will be resumed after a prior backup fails, unless resume=n has been specified. A resumed backup can be identified by checking the backup log for the message "aborted backup of same type exists, will be cleaned to remove invalid files and resumed". If the message exists, do not use this backup or any backup in the same set for a restore and check the restore logs to see if a resumed backup was restored. If so, there may be inconsistent data in the cluster.  
  
Bug Fixes:  
  
* Fix critical bug in resume that resulted in inconsistent backups. A regression in v0.82 removed the timestamp comparison when deciding which files from the aborted backup to keep on resume. See note above for more details. (Reported by David Youatt, Yogesh Sharma, Stephen Frost.)  
* Fix non-compliant ISO-8601 timestamp format in S3 authorization headers. AWS and some gateways were tolerant of space rather than zero-padded hours while others were not. (Fixed by Andrew Schwartz.)  
* Fix directory syncs running recursively when only the specified directory should be synced. (Reported by Craig A. James.)  
* Fix --target-action and --recovery-option options being reported as invalid when restoring with --type=immediate. (Reported by Brad Nicholson.)  
* Fix archive-copy throwing "path not found" error for incr/diff backups. (Reported by yummyliu, Vitaliy Kukharik.)  
* Fix failure in manifest build when two or more files in PGDATA are linked to the same directory. (Reported by Vitaliy Kukharik.)  
* Fix delta restore failing when a linked file was missing.  
* Fix error in selective restore when only one user database exists in the cluster. (Fixed by Cynthia Shang. Reported by Nj Baliyan.)  
  
Improvements:  
  
* Improve the HTTP client to set content-length to 0 when not specified by the server. S3 (and gateways) always set content-length or transfer-encoding but HTTP 1.1 does not require it and proxies (e.g. HAProxy) may not include either. (Suggested by Adam K. Sumner.)  
* Improve performance of HTTPS client. Buffering now takes the pending bytes on the socket into account (when present) rather than relying entirely on select(). In some instances the final bytes would not be flushed until the connection was closed.  
* Improve S3 delete performance. The constant S3_BATCH_MAX had been replaced with a hard-coded value of 2, probably during testing.  
* Make backup/restore path sync more efficient. Scanning the entire directory can be very expensive if there are a lot of small tables. The backup manifest contains the path list so use it to perform syncs instead of scanning the backup/restore path. Remove recursive path sync functionality since it is no longer used.  

commit   : f7123c1bbf239814b33ddc97e53b472cf0e69d16    
  
author   : David Steele <david@pgmasters.net>    
date     : Tue, 22 May 2018 19:53:25 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Tue, 22 May 2018 19:53:25 -0400    

Bug Fixes:  
  
* Fix potential buffer overrun in error message handling. (Reported by Lætitia.)  
* Fix archive write lock being taken for the synchronous archive-get command. (Reported by Uspen.)  
  
Improvements:  
  
* Embed exported C functions and Perl modules directly into the pgBackRest executable.  
* Use time_t instead of __time_t for better portability. (Suggested by Nick Floersch.)  
* Print total runtime in milliseconds at command end.  

commit   : ec8e7d60bac23b1b9102798afc30078aca9076ae    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:59:47 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:59:47 -0400    

commit   : 035524b11821343bf1236e8ea5b078b9508225df    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : 364998df87a8fc498302d4b02681909f81635914    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:57:35 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:57:35 -0400    

commit   : d289dcfc393c5329fb67a1df27957a9923365ce6    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : ceb2b0b0abaf0e7a14d25c3e75d4fd0b80714149    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:55:28 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:55:28 -0400    

commit   : 23a086a03fe635764c8f0879219a7adeb5a39b56    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : 2f895f784fb31bf008162e9c52cc0b2c717823e8    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:53:38 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:53:38 -0400    

commit   : e71d9f6951fa61f386bebe3c97735a80def8a1e2    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : ab5e9caa4a3ec4765348a0482e88edcf3f6aab4a    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:51:40 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 16:51:40 -0400    

commit   : f5f8b5892a08c678de878653fca906f85e399f27    
  
author   : Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    
  
committer: Tom Lane <tgl@sss.pgh.pa.us>    
date     : Mon, 7 May 2018 13:13:27 -0400    

commit   : ee8aafb3cadd77682c97bcc74adb457e0723ebee    
  
author   : David Steele <david@pgmasters.net>    
date     : Sun, 6 May 2018 19:53:42 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sun, 6 May 2018 19:53:42 -0400    

Bug Fixes:  
  
* Fix directory syncs running recursively when only the specified directory should be synced. (Reported by Craig A. James.)  
* Fix archive-copy throwing "path not found" error for incr/diff backups. (Reported by yummyliu, Vitaliy Kukharik.)  
* Fix failure in manifest build when two or more files in PGDATA are linked to the same directory. (Reported by Vitaliy Kukharik.)  
* Fix delta restore failing when a linked file is missing.  
* Fix rendering of key/value and list options in help. (Reported by Clinton Adams.)  
  
Features:  
  
* Add asynchronous, parallel archive-get. This feature maintains a queue of WAL segments to help reduce latency when PostgreSQL requests a WAL segment with restore_command.  
* Add support for additional pgBackRest configuration files in the directory specified by the --config-include-path option. Add --config-path option for overriding the default base path of the --config and --config-include-path option. (Contributed by Cynthia Shang.)  
* Add repo-s3-token option to allow temporary credentials tokens to be configured. pgBackRest currently has no way to request new credentials so the entire command (e.g. backup, restore) must complete before the credentials expire. (Contributed by Yogesh Sharma.)  
  
Improvements:  
  
* Update the archive-push-queue-max, manifest-save-threshold, and buffer-size options to accept values in KB, MB, GB, TB, or PB where the multiplier is a power of 1024. (Contributed by Cynthia Shang.)  
* Make backup/restore path sync more efficient. Scanning the entire directory can be very expensive if there are a lot of small tables. The backup manifest contains the path list so use it to perform syncs instead of scanning the backup/restore path.  
* Show command parameters as well as command options in initial info log message.  
* Rename archive-queue-max option to archive-push-queue-max to avoid confusion with the new archive-get-queue-max option. The old option name will continue to be accepted.  

commit   : 2a3d6ecde8a86154cfaba067dfcbe459ef2aa8e1    
  
author   : David Steele <david@pgmasters.net>    
date     : Mon, 19 Mar 2018 21:49:41 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Mon, 19 Mar 2018 21:49:41 -0400    

Bug Fixes:  
  
* Fix --target-action and --recovery-option options being reported as invalid when restoring with --type=immediate. (Reported by Brad Nicholson.)  
* Immediately error when a secure option (e.g. repo1-s3-key) is passed on the command line. Since pgBackRest would not pass secure options on to sub-processes an obscure error was thrown. The new error is much clearer and provides hints about how to fix the problem. Update command documentation to omit secure options that cannot be specified on the command-line. (Reported by Brad Nicholson.)  
* Fix issue passing --no-config to embedded Perl. (Reported by Ibrahim Edib Kokdemir.)  
* Fix issue where specifying log-level-stderr > warn would cause a local/remote process to error on exit due to output found on stderr when none was expected. The max value for a local/remote process is now error since there is no reason for these processes to emit warnings. (Reported by Clinton Adams.)  
* Fix manifest test in the check command when tablespaces are present. (Fixed by Cynthia Shang. Reported by Thomas Flatley.)  
  
Improvements:  
  
* Error when multiple arguments are set in the config file for an option that does not accept multiple arguments. (Contributed by Cynthia Shang.)  
* Remove extraneous sudo commands from src/Makefile. (Contributed by Adrian Vondendriesch.)