X Tutup
The Wayback Machine - https://web.archive.org/web/20201214233233/https://github.com/postgrespro/pg_probackup/issues/234
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dividing WAL segments by directories #234

Open
Bexilit opened this issue Jun 30, 2020 · 2 comments
Open

Dividing WAL segments by directories #234

Bexilit opened this issue Jun 30, 2020 · 2 comments
Assignees
Milestone

Comments

@Bexilit
Copy link

@Bexilit Bexilit commented Jun 30, 2020

Hi! I suggest dividing WALs from the archive into different directories, because when writing a large number of segments to the network directory (30-40 thousand per day, NFS for example) for several weeks, there are problems with the availability of the directory.

You can divide by dates hours or segment names (for example, as in barman)
Thanks!

@gsmol
Copy link
Contributor

@gsmol gsmol commented Jun 30, 2020

Hello!
Looks like a must have feature and, since we must be able to determine the segment location for WAL parsing, the barman way of grouping them per log segment (one directory for 256 segments) is a good way to do it.
Thank you for the feedback!

@gsmol gsmol added this to the 2.5.0 milestone Jun 30, 2020
@beremour
Copy link

@beremour beremour commented Aug 31, 2020

I'am usin NFS storage also. It's good to have something like /backup/instance/wal/YY-MM-DD/ subdirs

@gsmol gsmol self-assigned this Oct 29, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.
X Tutup