v2.02: Parallel Asynchronous Archive Get and Configuration Includes
commit : ee8aafb3cadd77682c97bcc74adb457e0723ebee
author : David Steele <david@pgmasters.net>
date : Sun, 6 May 2018 19:53:42 -0400
committer: David Steele <david@pgmasters.net>
date : Sun, 6 May 2018 19:53:42 -0400
Click here for diff
Bug Fixes:
* Fix directory syncs running recursively when only the specified directory should be synced. (Reported by Craig A. James.)
* Fix archive-copy throwing "path not found" error for incr/diff backups. (Reported by yummyliu, Vitaliy Kukharik.)
* Fix failure in manifest build when two or more files in PGDATA are linked to the same directory. (Reported by Vitaliy Kukharik.)
* Fix delta restore failing when a linked file is missing.
* Fix rendering of key/value and list options in help. (Reported by Clinton Adams.)
Features:
* Add asynchronous, parallel archive-get. This feature maintains a queue of WAL segments to help reduce latency when PostgreSQL requests a WAL segment with restore_command.
* Add support for additional pgBackRest configuration files in the directory specified by the --config-include-path option. Add --config-path option for overriding the default base path of the --config and --config-include-path option. (Contributed by Cynthia Shang.)
* Add repo-s3-token option to allow temporary credentials tokens to be configured. pgBackRest currently has no way to request new credentials so the entire command (e.g. backup, restore) must complete before the credentials expire. (Contributed by Yogesh Sharma.)
Improvements:
* Update the archive-push-queue-max, manifest-save-threshold, and buffer-size options to accept values in KB, MB, GB, TB, or PB where the multiplier is a power of 1024. (Contributed by Cynthia Shang.)
* Make backup/restore path sync more efficient. Scanning the entire directory can be very expensive if there are a lot of small tables. The backup manifest contains the path list so use it to perform syncs instead of scanning the backup/restore path.
* Show command parameters as well as command options in initial info log message.
* Rename archive-queue-max option to archive-push-queue-max to avoid confusion with the new archive-get-queue-max option. The old option name will continue to be accepted.
M README.md
M doc/resource/exe.cache
M doc/xml/index.xml
M doc/xml/release.xml
M lib/pgBackRest/Version.pm
M libc/lib/pgBackRest/LibCAuto.pm
M src/version.h
M test/code-count/file-type.yaml
v2.01: Minor Bug Fixes and Improvements
commit : 2a3d6ecde8a86154cfaba067dfcbe459ef2aa8e1
author : David Steele <david@pgmasters.net>
date : Mon, 19 Mar 2018 21:49:41 -0400
committer: David Steele <david@pgmasters.net>
date : Mon, 19 Mar 2018 21:49:41 -0400
Click here for diff
Bug Fixes:
* Fix --target-action and --recovery-option options being reported as invalid when restoring with --type=immediate. (Reported by Brad Nicholson.)
* Immediately error when a secure option (e.g. repo1-s3-key) is passed on the command line. Since pgBackRest would not pass secure options on to sub-processes an obscure error was thrown. The new error is much clearer and provides hints about how to fix the problem. Update command documentation to omit secure options that cannot be specified on the command-line. (Reported by Brad Nicholson.)
* Fix issue passing --no-config to embedded Perl. (Reported by Ibrahim Edib Kokdemir.)
* Fix issue where specifying log-level-stderr > warn would cause a local/remote process to error on exit due to output found on stderr when none was expected. The max value for a local/remote process is now error since there is no reason for these processes to emit warnings. (Reported by Clinton Adams.)
* Fix manifest test in the check command when tablespaces are present. (Fixed by Cynthia Shang. Reported by Thomas Flatley.)
Improvements:
* Error when multiple arguments are set in the config file for an option that does not accept multiple arguments. (Contributed by Cynthia Shang.)
* Remove extraneous sudo commands from src/Makefile. (Contributed by Adrian Vondendriesch.)
M README.md
M doc/resource/exe.cache
M doc/xml/release.xml
M lib/pgBackRest/Version.pm
M libc/lib/pgBackRest/LibCAuto.pm
M src/version.h
Revert restructuring of bin/scripts/Makefile
commit : 3652766ba932c7b7efdb2b29524898d881a94a33
author : Magnus Hagander <magnus@hagander.net>
date : Tue, 27 Feb 2018 14:08:53 +0100
committer: Magnus Hagander <magnus@hagander.net>
date : Tue, 27 Feb 2018 14:08:53 +0100
Click here for diff
The Makefile portion of 91f3ffc5249eff99c311fb27e7b29a44d9c62be1 broke
the MSVC build. This patch reverts the changes to the Makefile and
adjusts it to work with the new code, while keeping the actual code
changes from the original patch.
Author: Victor Wagner <vitus@wagner.pp.ru>
M src/bin/scripts/Makefile
Revert restructuring of bin/scripts/Makefile
commit : 5181bebba73b2fdcb38f4c7f06491e8092873969
author : Magnus Hagander <magnus@hagander.net>
date : Tue, 27 Feb 2018 14:08:53 +0100
committer: Magnus Hagander <magnus@hagander.net>
date : Tue, 27 Feb 2018 14:08:53 +0100
Click here for diff
The Makefile portion of 91f3ffc5249eff99c311fb27e7b29a44d9c62be1 broke
the MSVC build. This patch reverts the changes to the Makefile and
adjusts it to work with the new code, while keeping the actual code
changes from the original patch.
Author: Victor Wagner <vitus@wagner.pp.ru>
M src/bin/scripts/Makefile
Revert restructuring of bin/scripts/Makefile
commit : 41545d1524eb461b91698f53316b556c96aaf3a5
author : Magnus Hagander <magnus@hagander.net>
date : Tue, 27 Feb 2018 14:08:53 +0100
committer: Magnus Hagander <magnus@hagander.net>
date : Tue, 27 Feb 2018 14:08:53 +0100
Click here for diff
The Makefile portion of 91f3ffc5249eff99c311fb27e7b29a44d9c62be1 broke
the MSVC build. This patch reverts the changes to the Makefile and
adjusts it to work with the new code, while keeping the actual code
changes from the original patch.
Author: Victor Wagner <vitus@wagner.pp.ru>
M src/bin/scripts/Makefile
Stamp 9.6.8.
commit : ad5fe2d22d020a439e96d476c65eb43885338d86
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 17:13:40 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 17:13:40 -0500
Click here for diff
M configure
M configure.in
M doc/bug.template
M src/include/pg_config.h.win32
M src/interfaces/libpq/libpq.rc.in
M src/port/win32ver.rc
Schema-qualify references in test_ddl_deparse test script.
commit : 3300e876cd45cf169d981fa53f9c9e8289ee3c82
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 12:22:39 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 12:22:39 -0500
Click here for diff
Stamp 10.3.
commit : 65c6b53991e1c56f6a0700ae26928962ddf2b9fe
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 17:10:47 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 17:10:47 -0500
Click here for diff
M configure
M configure.in
M doc/bug.template
M src/include/pg_config.h.win32
M src/interfaces/libpq/libpq.rc.in
M src/port/win32ver.rc
Schema-qualify references in test_ddl_deparse test script.
commit : fdf521d697a37fbaa283e7b9de3ffc7f5029f544
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 12:22:39 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 26 Feb 2018 12:22:39 -0500
Click here for diff
commit : 13cdb75ac56609c6a1d2f7cb3c31c0f0b29ecc3b
author : David Steele <david@pgmasters.net>
date : Fri, 23 Feb 2018 22:38:45 -0500
committer: David Steele <david@pgmasters.net>
date : Fri, 23 Feb 2018 22:38:45 -0500
Click here for diff
Features:
* The archive-push command is now partially coded in C which allows the PostgreSQL archive_command to run significantly faster when processing status messages from the asynchronous archive process. (Reviewed by Cynthia Shang.)
Improvements:
* Improve check command to verify that the backup manifest can be built. (Contributed by Cynthia Shang.)
* Improve performance of HTTPS client. Buffering now takes the pending bytes on the socket into account (when present) rather than relying entirely on select(). In some instances the final bytes would not be flushed until the connection was closed.
* Improve S3 delete performance. The constant S3_BATCH_MAX had been replaced with a hard-coded value of 2, probably during testing.
* Allow any non-command-line option to be reset to default on the command-line. This allows options in pgbackrest.conf to be reset to default which reduces the need to write new configuration files for specific needs.
* The C library is now required. This eliminates conditional loading and eases development of new library features.
* The pgbackrest executable is now a C binary instead of Perl. This allows certain time-critical commands (like async archive-push) to run more quickly.
* Rename db-* options to pg-* and backup-* options to repo-* to improve consistency. repo-* options are now indexed although currently only one is allowed.
M README.md
M doc/resource/exe.cache
M doc/xml/index.xml
M doc/xml/release.xml
M doc/xml/user-guide.xml
M lib/pgBackRest/Version.pm
M libc/lib/pgBackRest/LibCAuto.pm
M src/version.h
Stamp 9.3.21.
commit : 0a0ee721f8190f8e6e633aa959bf9801932bd361
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 16:08:57 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 16:08:57 -0500
Click here for diff
M configure
M configure.in
M doc/bug.template
M src/include/pg_config.h.win32
M src/interfaces/libpq/libpq.rc.in
M src/port/win32ver.rc
Last-minute updates for release notes.
commit : 01b2db1cd6673a94cc5249aa25b34e7d98535c11
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 14:43:41 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 14:43:41 -0500
Click here for diff
Stamp 9.4.16.
commit : b7e1ca7d8e65319cc325bdbc757e723ce5b02937
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 16:07:03 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 16:07:03 -0500
Click here for diff
M configure
M configure.in
M doc/bug.template
M src/include/pg_config.h.win32
M src/interfaces/libpq/libpq.rc.in
M src/port/win32ver.rc
Last-minute updates for release notes.
commit : 9a12ac37be9683da09c3dc33d0ee43728ca49517
author : Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 14:43:40 -0500
committer: Tom Lane <tgl@sss.pgh.pa.us>
date : Mon, 5 Feb 2018 14:43:40 -0500
Click here for diff