pgBackRest 1.23 commit log

v1.23: Multiple Standbys and PostgreSQL 10 Support

commit   : df1ec0aaeb02fb1359f5f893dad8af06c2e05eeb    
  
author   : David Steele <david@pgmasters.net>    
date     : Sun, 3 Sep 2017 17:42:00 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sun, 3 Sep 2017 17:42:00 -0400    

Click here for diff

Bug Fixes:  
  
* Fixed an issue that could cause compression to abort on growing files. (Reported by Jesper St John, Aleksandr Rogozin.)  
* Fixed an issue with keep-alives not being sent to the remote from the local process. (Reported by William Cox.)  
  
Features:  
  
* Up to seven standbys can be configured for backup from standby. (Contributed by Cynthia Shang.)  
* PostgreSQL 10 support.  
* Allow content-length (in addition to chunked encoding) when reading XML data to improve compatibility with third-party S3 gateways. (Suggested by Victor Gdalevich.)  
  
Refactoring:  
  
* Configuration rules are now pulled from the C library when present.  
* Increase HTTP timeout for S3.  
* Add HTTP retries to harden against transient S3 network errors.  

M README.md
M doc/resource/exe.cache
M doc/xml/release.xml
M lib/pgBackRest/Version.pm

Add HTTP retries to harden against transient S3 network errors.

commit   : eea2ccc3ab52ee588d6f894d291931bd9aa52147    
  
author   : David Steele <david@pgmasters.net>    
date     : Sun, 3 Sep 2017 16:48:41 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sun, 3 Sep 2017 16:48:41 -0400    

Click here for diff

M doc/xml/release.xml
M lib/pgBackRest/Common/Http/Client.pm
M lib/pgBackRest/Storage/S3/Request.pm
M test/lib/pgBackRestTest/Common/DefineTest.pm
M test/lib/pgBackRestTest/Module/Common/CommonHttpClientTest.pm

Increase HTTP timeout for S3.

commit   : 80e5e8db01b97ad7878817152d2a9a933d59d415    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 1 Sep 2017 19:16:57 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 1 Sep 2017 19:16:57 -0400    

Click here for diff

M doc/xml/release.xml
M lib/pgBackRest/Common/Http/Client.pm

Allow content-length (in addition to chunked encoding) when reading XML data to improve compatibility with third-party S3 gateways.

commit   : 75511d24813266b87a7b65e25141f2fd6b1dd78a    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 1 Sep 2017 15:07:20 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 1 Sep 2017 15:07:20 -0400    

Click here for diff

Suggested by Victor Gdalevich.  

M doc/xml/release.xml
M lib/pgBackRest/Common/Http/Client.pm
M test/lib/pgBackRestTest/Common/DefineTest.pm
A test/lib/pgBackRestTest/Module/Common/CommonHttpClientTest.pm

PostgreSQL 10 support.

commit   : fcb7c6fd1d0f37ed371079537b95899eaac44812    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 1 Sep 2017 12:29:34 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 1 Sep 2017 12:29:34 -0400    

Click here for diff

M doc/xml/reference.xml
M doc/xml/release.xml
M doc/xml/user-guide.xml
M lib/pgBackRest/Archive/Common.pm
M lib/pgBackRest/Backup/Backup.pm
M lib/pgBackRest/Check/Check.pm
M lib/pgBackRest/Config/ConfigHelpData.pm
M lib/pgBackRest/Db.pm
M lib/pgBackRest/DbVersion.pm
M lib/pgBackRest/Manifest.pm
M lib/pgBackRest/Restore.pm
M src/postgres/pageChecksum.c
M test/expect/help-help-001.log
M test/expect/mock-all-001.log
M test/expect/mock-all-002.log
M test/lib/pgBackRestTest/Common/ContainerTest.pm
M test/lib/pgBackRestTest/Common/VmTest.pm
M test/lib/pgBackRestTest/Env/ExpireEnvTest.pm
M test/lib/pgBackRestTest/Env/Host/HostDbCommonTest.pm
M test/lib/pgBackRestTest/Env/Host/HostDbTest.pm
M test/lib/pgBackRestTest/Env/HostEnvTest.pm
M test/lib/pgBackRestTest/Module/Archive/ArchiveCommonTest.pm
M test/lib/pgBackRestTest/Module/Archive/ArchiveStopTest.pm
M test/lib/pgBackRestTest/Module/Mock/MockArchiveTest.pm
M test/lib/pgBackRestTest/Module/Mock/MockStanzaTest.pm
M test/lib/pgBackRestTest/Module/Real/RealAllTest.pm

Up to seven standbys can be configured for backup from standby.`

commit   : 36e576b4839d5d9323597014d6f478def7308d9e    
  
author   : Cynthia Shang <cynthia.shang@crunchydata.com>    
date     : Thu, 31 Aug 2017 19:15:44 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 31 Aug 2017 19:15:44 -0400    

Click here for diff

Contributed by Cynthia Shang.  

M doc/xml/reference.xml
M doc/xml/release.xml
M doc/xml/user-guide.xml
M lib/pgBackRest/Backup/Backup.pm
M lib/pgBackRest/Check/Check.pm
M lib/pgBackRest/Common/Log.pm
M lib/pgBackRest/Config/Data.pm
M lib/pgBackRest/Db.pm
M lib/pgBackRest/Stanza.pm
M libc/t/config.t
M src/config/config.auto.md
M src/config/configRule.auto.md
M test/expect/mock-all-001.log
M test/expect/mock-all-002.log
M test/expect/mock-archive-001.log
M test/expect/mock-archive-002.log
M test/expect/real-all-002.log
M test/expect/real-all-003.log
M test/expect/real-all-005.log
M test/lib/pgBackRestTest/Common/DefineTest.pm
M test/lib/pgBackRestTest/Env/Host/HostBackupTest.pm
A test/lib/pgBackRestTest/Module/Common/CommonLogTest.pm
M test/lib/pgBackRestTest/Module/Real/RealAllTest.pm

Fixed an issue that could cause compression to abort on growing files.

commit   : 206415d4c754053275666bfcc0eb138f39884c21    
  
author   : David Steele <david@pgmasters.net>    
date     : Wed, 30 Aug 2017 16:34:05 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Wed, 30 Aug 2017 16:34:05 -0400    

Click here for diff

Reported by Jesper St John, Aleksandr Rogozin.  

M doc/xml/release.xml
M lib/pgBackRest/Common/Io/Handle.pm
M lib/pgBackRest/Storage/Filter/Gzip.pm
M test/lib/pgBackRestTest/Module/Common/CommonIoHandleTest.pm
M test/lib/pgBackRestTest/Module/Storage/StorageFilterGzipTest.pm

Fixed an issue with keep-alives not being sent to the remote from the local process.

commit   : 81ffd094455fb006993a3b9e65c801c127454dc7    
  
author   : David Steele <david@crunchydata.com>    
date     : Wed, 30 Aug 2017 08:41:46 -0400    
  
committer: David Steele <david@crunchydata.com>    
date     : Wed, 30 Aug 2017 08:41:46 -0400    

Click here for diff

Reported by William Cox.  

M doc/xml/release.xml
M lib/pgBackRest/Protocol/Base/Minion.pm
M lib/pgBackRest/Protocol/Local/Minion.pm
M test/lib/pgBackRestTest/Common/DefineTest.pm

Configuration rules are now pulled from the C library when present.

commit   : 1e0ed074555df7d9079fdf52c4b6b5b049b6d155    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 25 Aug 2017 16:47:47 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 25 Aug 2017 16:47:47 -0400    

Click here for diff

M .gitignore
M bin/pgbackrest
A build/lib/pgBackRestBuild/Build.pm
A build/lib/pgBackRestBuild/Build/Common.pm
A build/lib/pgBackRestBuild/CodeGen/Common.pm
A build/lib/pgBackRestBuild/CodeGen/Lookup.pm
A build/lib/pgBackRestBuild/CodeGen/Switch.pm
A build/lib/pgBackRestBuild/CodeGen/Truth.pm
A build/lib/pgBackRestBuild/Config/Build.pm
A build/lib/pgBackRestBuild/Config/Rule.pm
M doc/doc.pl
M doc/lib/BackRestDoc/Common/Doc.pm
M doc/lib/BackRestDoc/Common/DocConfig.pm
M doc/lib/BackRestDoc/Common/DocExecute.pm
M doc/lib/BackRestDoc/Custom/DocCustomRelease.pm
M doc/lib/BackRestDoc/Html/DocHtmlPage.pm
M doc/lib/BackRestDoc/Latex/DocLatexSection.pm
M doc/lib/BackRestDoc/Markdown/DocMarkdownRender.pm
M doc/release.pl
M doc/xml/release.xml
M doc/xml/user-guide.xml
M lib/pgBackRest/Archive/Base.pm
M lib/pgBackRest/Archive/Get/Get.pm
M lib/pgBackRest/Archive/Push/Async.pm
M lib/pgBackRest/Archive/Push/File.pm
M lib/pgBackRest/Archive/Push/Push.pm
M lib/pgBackRest/Backup/Backup.pm
M lib/pgBackRest/Backup/Common.pm
M lib/pgBackRest/Backup/Filter/PageChecksum.pm
M lib/pgBackRest/Backup/Info.pm
M lib/pgBackRest/Check/Check.pm
M lib/pgBackRest/Common/Lock.pm
M lib/pgBackRest/Common/Log.pm
M lib/pgBackRest/Config/Config.pm
M lib/pgBackRest/Config/ConfigHelp.pm
M lib/pgBackRest/Config/ConfigHelpData.pm
A lib/pgBackRest/Config/Data.pm
A lib/pgBackRest/Config/LoadFailback.pm
A lib/pgBackRest/Config/Rule.pm
M lib/pgBackRest/Db.pm
M lib/pgBackRest/Expire.pm
M lib/pgBackRest/Info.pm
A lib/pgBackRest/LibCLoad.pm
M lib/pgBackRest/Manifest.pm
M lib/pgBackRest/Protocol/Helper.pm
M lib/pgBackRest/Protocol/Local/Master.pm
M lib/pgBackRest/Protocol/Local/Minion.pm
M lib/pgBackRest/Protocol/Local/Process.pm
M lib/pgBackRest/Protocol/Remote/Minion.pm
M lib/pgBackRest/Protocol/Storage/Helper.pm
M lib/pgBackRest/Protocol/Storage/Remote.pm
M lib/pgBackRest/Restore.pm
M lib/pgBackRest/Stanza.pm
M lib/pgBackRest/Storage/Helper.pm
M lib/pgBackRest/Version.pm
M libc/.gitignore
M libc/LibC.h
M libc/LibC.xs
M libc/Makefile.PL
D libc/lib/pgBackRest/LibC.pm
A libc/t/config.t
A src/.gitignore
A src/common/type.h
A src/config/config.auto.md
A src/config/config.c
A src/config/config.h
A src/config/configRule.auto.md
A src/config/configRule.c
A src/config/configRule.h
R100 libc/pageChecksum.c src/postgres/pageChecksum.c
A src/postgres/pageChecksum.h
M test/expect/archive-stop-001.log
M test/expect/archive-stop-002.log
M test/expect/archive-stop-003.log
M test/expect/archive-stop-004.log
M test/expect/archive-stop-005.log
M test/expect/archive-stop-006.log
M test/expect/archive-stop-007.log
M test/expect/expire-expire-001.log
M test/expect/expire-expire-002.log
M test/expect/help-help-001.log
M test/expect/mock-all-001.log
M test/expect/mock-all-002.log
M test/expect/mock-all-003.log
M test/expect/mock-archive-001.log
M test/expect/mock-archive-002.log
M test/expect/mock-archive-003.log
M test/expect/mock-stanza-001.log
M test/expect/mock-stanza-002.log
M test/expect/mock-stanza-003.log
M test/lib/pgBackRestTest/Common/JobTest.pm
M test/lib/pgBackRestTest/Common/RunTest.pm
M test/lib/pgBackRestTest/Env/ConfigEnvTest.pm
M test/lib/pgBackRestTest/Env/ExpireEnvTest.pm
M test/lib/pgBackRestTest/Env/Host/HostBackupTest.pm
M test/lib/pgBackRestTest/Env/Host/HostDbCommonTest.pm
M test/lib/pgBackRestTest/Env/HostEnvTest.pm
M test/lib/pgBackRestTest/Module/Archive/ArchiveCommonTest.pm
M test/lib/pgBackRestTest/Module/Archive/ArchivePushTest.pm
M test/lib/pgBackRestTest/Module/Archive/ArchiveStopTest.pm
M test/lib/pgBackRestTest/Module/Backup/BackupInfoUnitTest.pm
M test/lib/pgBackRestTest/Module/Backup/BackupUnitTest.pm
M test/lib/pgBackRestTest/Module/Config/ConfigConfigTest.pm
M test/lib/pgBackRestTest/Module/Config/ConfigOptionTest.pm
M test/lib/pgBackRestTest/Module/Config/ConfigUnitTest.pm
M test/lib/pgBackRestTest/Module/Expire/ExpireExpireTest.pm
M test/lib/pgBackRestTest/Module/Help/HelpHelpTest.pm
M test/lib/pgBackRestTest/Module/Info/InfoUnitTest.pm
M test/lib/pgBackRestTest/Module/Mock/MockAllTest.pm
M test/lib/pgBackRestTest/Module/Mock/MockArchiveTest.pm
M test/lib/pgBackRestTest/Module/Mock/MockStanzaTest.pm
M test/lib/pgBackRestTest/Module/Performance/PerformanceArchiveTest.pm
M test/lib/pgBackRestTest/Module/Protocol/ProtocolHelperTest.pm
M test/lib/pgBackRestTest/Module/Real/RealAllTest.pm
M test/lib/pgBackRestTest/Module/Stanza/StanzaAllTest.pm
M test/lib/pgBackRestTest/Module/Storage/StorageHelperTest.pm
M test/lib/pgBackRestTest/Module/Storage/StorageS3CertTest.pm
M test/test.pl

Merge release 2 container build changes.

commit   : 8d3436bce775845d45eaf8b55e526ad784e54e0f    
  
author   : David Steele <david@pgmasters.net>    
date     : Sat, 19 Aug 2017 09:02:24 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sat, 19 Aug 2017 09:02:24 -0400    

Click here for diff

M doc/xml/release.xml
M test/lib/pgBackRestTest/Common/ContainerTest.pm

Simplified smart logic for C Library and package builds.

commit   : 7dab459cacd9e1b5934294176e5929a86f7b48de    
  
author   : David Steele <david@pgmasters.net>    
date     : Sat, 19 Aug 2017 08:48:13 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Sat, 19 Aug 2017 08:48:13 -0400    

Click here for diff

M doc/xml/release.xml
M test/lib/pgBackRestTest/Env/Host/HostBaseTest.pm
M test/test.pl

Fixed document generation to include section summaries on the Configuration page.

commit   : 1be69d5ac71db241f0c41bf28c4c36c5cc0b32c4    
  
author   : Cynthia Shang <cynthia.shang@crunchydata.com>    
date     : Wed, 16 Aug 2017 16:54:35 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Wed, 16 Aug 2017 16:54:35 -0400    

Click here for diff

Fixed by Cynthia Shang.  

M doc/lib/BackRestDoc/Common/DocConfig.pm
M doc/xml/release.xml

Move contributor list to the end of release.xml for convenience.

commit   : 1d2b08ce94d31e2d0a19cb7f489d73e2e04700d2    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 11 Aug 2017 18:43:21 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 11 Aug 2017 18:43:21 -0400    

Click here for diff

M doc/xml/dtd/doc.dtd
M doc/xml/release.xml

Ignore auto-generated C code created by release 2.

commit   : 4c2c612b6f68001b2cf0ccd29b02648f0f11ae8c    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 11 Aug 2017 18:38:40 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 11 Aug 2017 18:38:40 -0400    

Click here for diff

M .gitignore
M doc/xml/release.xml

Drain stderr during test process execution as well as termination to prevent lockups if there is a lot of output.

commit   : 4331e09376a124e597c4a0e8e4c9641239f8f64e    
  
author   : David Steele <david@pgmasters.net>    
date     : Fri, 11 Aug 2017 18:31:25 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Fri, 11 Aug 2017 18:31:25 -0400    

Click here for diff

M doc/xml/release.xml
M test/lib/pgBackRestTest/Common/ExecuteTest.pm

Updated Docker build in Vagrantfile.

commit   : f8de73674c5e97bd7103a4892ce4d17cc12d1173    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 10 Aug 2017 20:52:29 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 10 Aug 2017 20:52:29 -0400    

Click here for diff

M doc/xml/release.xml
M test/Vagrantfile

Changed log test order to ignore unimportant log errors while shutting down PostgreSQL.

commit   : ac1574448e8b6e2a6b6c3690f3998aac35e4d40d    
  
author   : David Steele <david@pgmasters.net>    
date     : Thu, 10 Aug 2017 18:11:29 -0400    
  
committer: David Steele <david@pgmasters.net>    
date     : Thu, 10 Aug 2017 18:11:29 -0400    

Click here for diff

M doc/xml/release.xml
M test/lib/pgBackRestTest/Env/Host/HostDbTest.pm