bpo-37129: Add os.RWF_APPEND flag for os.pwritev #13735

bezoka · 2019-06-01T21:52:31Z

https://bugs.python.org/issue37129

the-knights-who-say-ni · 2019-06-01T21:52:34Z

Hello, and thanks for your contribution!

I'm a bot set up to make sure that the project can legally accept your contribution by verifying you have signed the PSF contributor agreement (CLA).

Our records indicate we have not received your CLA. For legal reasons we need you to sign this before we can look at your contribution. Please follow the steps outlined in the CPython devguide to rectify this issue.

If you have recently signed the CLA, please wait at least one business day
before our records are updated.

You can check yourself to see if the CLA has been received.

Thanks again for your contribution, we look forward to reviewing it!

YoSTEALTH · 2019-06-01T21:59:21Z

Doc/library/os.rst

+
+   Append data to the end of the file.
+
+   .. availability:: Linux 4.7 and newer.


it should be "Linux 4.16 and newer."

YoSTEALTH · 2019-06-01T22:47:36Z

Doc/library/os.rst

@@ -1230,6 +1231,15 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo
   .. versionadded:: 3.7


+.. data:: RWF_APPEND
+
+   Append data to the end of the file.


Append data to the end of the file. See the description of the flag of the same name in os.pwritev() as well as the description of O_APPEND in os.open(). The offset field is ignored. The file offset is not changed.

YoSTEALTH · 2019-06-01T23:43:59Z

Doc/library/os.rst

@@ -1230,6 +1231,16 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo
   .. versionadded:: 3.7


+.. data:: RWF_APPEND
+
+   Append data to the end of the file. See the description of the flag 'O_APPEND' in ''os.open()''.


sorry "Provide a per-write equivalent of the O_APPEND in os.open(). This flag effect applies only to the data range written by the system call. The offset argument does not affect the write operation; the data is always appended to the end of the file. However, if the offset argument is -1, the current file offset is updated." I am sure vstinner will want to change this description again :)

vstinner · 2019-06-02T21:20:16Z

Modules/clinic/posixmodule.c.h

@@ -5334,6 +5334,7 @@ PyDoc_STRVAR(os_pwritev__doc__,
 "\n"
 "- RWF_DSYNC\n"
 "- RWF_SYNC\n"
+"- RWF_APPEND\n"


You must also update posixmodule.c docstring, and then run "make clinic" to regenerate this file.

This was tried travis-ci seems to fail

Please modify Modules/posixmodule.c and then run "make clinic".

YoSTEALTH · 2019-06-04T16:16:52Z

Modules/posixmodule.c

@@ -14023,6 +14023,9 @@ all_ins(PyObject *m)
 #ifdef RWF_NOWAIT
    if (PyModule_AddIntConstant(m, "RWF_NOWAIT", RWF_NOWAIT)) return -1;
 #endif
+#ifdef RWF_APPEND
+    if (PyModule_AddIntConstant(m, "RWF_APPEND", RWF_APPEND)) return -1;
+#endif



Need to add - RWF_APPEND on line: 9396

vstinner · 2019-06-07T17:27:18Z

Doc/library/os.rst

@@ -1230,6 +1231,16 @@ or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windo
   .. versionadded:: 3.7


+.. data:: RWF_APPEND
+
+   Append data to the end of the file. See the description of the flag 'O_APPEND' in ''os.open()''.


'O_APPEND' should be written :data:O_APPEND.

''os.open()'' should be written :func:os.open to add a link.

But os.open() doesn't document O_APPEND, just "The above constants are available on Unix and Windows"...

I would prefer to copy preadv Linux manual page:

RWF_APPEND (since Linux 4.16) Provide a per-write equivalent of the O_APPEND open(2) flag. This flag is meaningful only for pwritev2(), and its effect applies only to the data range written by the system call. The offset argument does not affect the write operation; the data is always appended to the end of the file. However, if the offset argument is -1, the current file offset is updated.

(Adapt it to Python names.)

vstinner · 2019-06-07T17:28:29Z

Misc/NEWS.d/next/Library/2019-06-01-21-58-50.bpo-37129.Uzw_V-.rst

@@ -0,0 +1 @@
+add RWF_APPEND flag


I suggest:

Add a new :data:`os.RWF_APPEND` flag for :func:`os.pwritev`.

bedevere-bot · 2019-06-07T17:28:42Z

A Python core developer has requested some changes be made to your pull request before we can consider merging it. If you could please address their requests along with any other requests in other reviews from core developers that would be appreciated.

Once you have made the requested changes, please leave a comment on this pull request containing the phrase I have made the requested changes; please review again. I will then notify any core developers who have left a review that you're ready for them to take another look at this pull request.

terryjreedy · 2019-06-07T18:53:01Z

Doc/library/os.rst

+
+   .. availability:: Linux 4.16 and newer.
+
+   .. versionadded:: 3.8


Suggested change

.. versionadded:: 3.8

.. versionadded:: 3.9

terryjreedy · 2019-06-07T19:01:38Z

The build failure, which I leave to someone else to interpret:
Error in file "./Modules/posixmodule.c" on line 14530:
Checksum mismatch!
Expected: b3ae8afd275ea5cd
Computed: bd017fb8bd0ad675
Suggested fix: remove all generated code including the end marker,
or use the '-f' option.
make: *** [clinic] Error 255

vstinner · 2019-06-07T20:46:54Z

You can use: ./python Tools/clinic/clinic.py Modules/posixmodule.c -f

vstinner · 2019-06-11T10:57:32Z

@bezoka: Would you mind to update your PR for my latest comments? (update the doc) This PR can still land into Python 3.8.0, since it only adds a new constant.

csabella · 2020-05-23T00:02:01Z

I am going to close this PR as abandoned (the original author has not been active in nearly a year). This is available for someone else to make a new PR. Please credit the original author in the commit message.

terryjreedy · 2020-05-23T02:43:23Z

I just noticed that the this PR proposes to merge bezoka's cpython master branch rather than an issue branch from master. This being rather fragile, this should have been closed and redone immediately. It should not be reopened even if it could be.

add RWF_APPEND flag

98608b9

the-knights-who-say-ni added the CLA not signed label Jun 1, 2019

bedevere-bot added the awaiting review label Jun 1, 2019

📜🤖 Added by blurb_it.

f4ab619

YoSTEALTH reviewed Jun 1, 2019

View reviewed changes

bezoka added 2 commits June 2, 2019 00:08

fix typo

10c34b4

Merge branch 'master' of https://github.com/bezoka/cpython

d0cedc4

YoSTEALTH reviewed Jun 1, 2019

View reviewed changes

bezoka added 2 commits June 2, 2019 01:02

Extend documentation

2504743

Add test to RWF_NOWAIT flag

8ba3028

YoSTEALTH reviewed Jun 1, 2019

View reviewed changes

remove not needed test

884466e

vstinner reviewed Jun 2, 2019

View reviewed changes

YoSTEALTH reviewed Jun 4, 2019

View reviewed changes

vstinner requested changes Jun 7, 2019

View reviewed changes

bedevere-bot removed the awaiting review label Jun 7, 2019

bedevere-bot added the awaiting changes label Jun 7, 2019

terryjreedy changed the title ~~bpo-37129: add RWF_APPEND flag~~ bpo-37129: Add os.RWF_APPEND flag for os.pwritev Jun 7, 2019

terryjreedy requested changes Jun 7, 2019

View reviewed changes

brettcannon removed the CLA not signed label Aug 8, 2019

the-knights-who-say-ni added the CLA signed label Aug 8, 2019

csabella closed this May 23, 2020

YoSTEALTH mentioned this pull request May 23, 2020

bpo-37129: Add os.RWF_APPEND flag for os.pwritev #20336

Merged


		Append data to the end of the file.

		.. availability:: Linux 4.7 and newer.


		.. availability:: Linux 4.16 and newer.

		.. versionadded:: 3.8

Uh oh!

bpo-37129: Add os.RWF_APPEND flag for os.pwritev #13735

bpo-37129: Add os.RWF_APPEND flag for os.pwritev #13735

Uh oh!

Conversation

bezoka commented Jun 1, 2019 • edited by bedevere-bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

the-knights-who-say-ni commented Jun 1, 2019

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

bedevere-bot commented Jun 7, 2019

Uh oh!

Choose a reason for hiding this comment

Uh oh!

terryjreedy commented Jun 7, 2019

Uh oh!

vstinner commented Jun 7, 2019

Uh oh!

vstinner commented Jun 11, 2019

Uh oh!

csabella commented May 23, 2020

Uh oh!

terryjreedy commented May 23, 2020

Uh oh!

Uh oh!

bezoka commented Jun 1, 2019 •

edited by bedevere-bot

Loading