128 Commits

Author SHA1 Message Date
Jenkins
c47d38dc94 Merge "Add driver list to doc build" 2016-07-29 02:24:22 +00:00
Jenkins
d2baafc2a4 Merge "Docs: remove todo list generation" 2016-07-26 18:50:26 +00:00
Jenkins
eabd2e8718 Merge "Update doc README and remove old Makefile" 2016-07-26 18:50:03 +00:00
Jenkins
52ad7bcc75 Merge "Docs: cleanup doc8 errors" 2016-07-26 18:49:42 +00:00
Sean McGinnis
8148038e92 Add driver list to doc build
We have tox -e gendriverlist that outputs an RST-ish report of all drivers
in the tree. This output can be used in the docs build to automatically
publish the list of drivers to make it easier to find officially supported
drivers.

This effectively removes the existing drivers.html that was generated prior
that did not actually contain any useful information.

Change-Id: I8de78723af76aabcc976733ac4b248db0b8ca16f
2016-07-26 11:09:05 -05:00
Jenkins
53ac615273 Merge "Add interface documentation to driver devref" 2016-07-26 02:55:00 +00:00
Sean McGinnis
3c18c6f440 Add interface documentation to driver devref
Link the docstring generated documentation for the driver interfaces into
the drivers devref page for easy access to driver method documentation.

Change-Id: Ie22599fef99ebfac12f3b9bb251ae5bdfff4bff6
2016-07-24 17:23:29 -05:00
Sean McGinnis
5abd344818 Docs: cleanup doc8 errors
Fix errors identified by doc8 other than D001 for lines too long.

Change-Id: If351030cd5add101a19be4b5b759f56ca49b92d0
2016-07-23 20:57:04 -05:00
Sean McGinnis
14f378a580 Docs: remove todo list generation
We had an extension for pulling out todo information from our docs. This
doesn't appear to have ever really been used though. Only a couple todo items
were published to the Cinder documentation, and the two published appear to
be extremely old.

Since this isn't really used and could just cause confusion, removing this
from the index page and removing the sphinx extension used to generate it.

Change-Id: I8993633538a5ee1687c4721bce3c520e8fb4ccfd
2016-07-23 18:15:42 -05:00
Sean McGinnis
8d9cad38e4 Update doc README and remove old Makefile
The information in the README file in the doc directory was very out of
date and the Makefile referenced in it doesn't appear to work any more.

Our preferred doc build method is to stay consistent with using tox -e docs,
so removing the legacy build information and providing better details for
doc development.

Change-Id: Ifd01b9cfc39fe99697a1669ecb5db6302359b662
2016-07-23 18:04:04 -05:00
Gorka Eguileor
a8edbd2e8d Improve api_version decorator to avoid noqa
Our existing `api_version` decorator for microversions forces us to use
"# noqa" if we have multiple microversions of a method in the same
class, providing no way around this.

This patch adds a way to avoid using noqa directive.  Previously we
would have:

 @wsgi.Controller.api_version("3.3")
 def my_api_method(self, req, id):
     .... method_1 ...

 @wsgi.Controller.api_version("3.4")  # noqa
 def my_api_method(self, req, id):
     .... method_2 ...

With this patch the second method does not require noqa anymore:

 @my_api_method.api_version("3.4")
 def my_api_method(self, req, id):
     .... method_2 ...

Devref is updated to reflect this new change and to mention that it is
the recommended way to do it.

Change-Id: I46283b52cc6a347d5deb0f57a123eba4e01a3eb2
Closes-Bug: #1599806
2016-07-22 10:27:26 +02:00
Vipin Balachandran
f01ae06084 Add README in release notes directory
This patch adds a README in release notes directory.

Change-Id: Ib1678d3a3c729cfec17466a05bb88416175c78d6
2016-07-01 19:03:26 +05:30
Jenkins
1cd90c646a Merge "Add test type clarification to devref" 2016-06-16 06:41:25 +00:00
Sean McGinnis
e7b40242f8 Add driver interface checks
This is the start of an effort to both validate that drivers fully
implement the expected minimum requirements as well as to create a clear
place for driver developers to learn what needs to be implemented and get
documentation explaining what is expected for each method.

This also enables us to create tooling for documenting the available
drivers and their capabilities, to some degree. A follow up patch will
show some of what I'm thinking there, but it will make it possible to write
scripts for different needs.

This is somewhat a cleanup attempt to the ABC work that was started a
while back. This does not aim to replace that effort, but give a
mechanism for some of the things expected out of that effort that ended
up not being possible with how it evolved.

In most cases we do not really care if a driver is inherited from a
certain base class, just that it conforms to the given interface.

The interface/inheritance work really centers around two separate
things:

 * Ensuring drivers conform to an expected interface
 * Allowing code reuse and common implementation

This is really for the first item. Additional work is needed to complete
the ABC work we've done, but that really focuses on the second item, and
is out of scope for the intent of this patch.

Change-Id: I4168225126fe88c31712d94f0a130e9e7ede3446
2016-06-13 15:21:47 +00:00
Sean McGinnis
61238e2e54 Add test type clarification to devref
We now have unit, functional, and tempest tests in tree. To avoid
confusion, we need to make sure it's clear what each of these test
types are intended to be used for.

This adds a description for each test type and cleans up some of
the documentation around testing in general.

Change-Id: I15bba187889e058adbf03deb4308a41d0a6248e3
2016-06-13 10:15:54 -05:00
Jenkins
b230cb743c Merge "Add sample config file to cinder docs" 2016-06-09 23:00:39 +00:00
Jenkins
9804d7376a Merge "Add error messages to conditional updates devref" 2016-06-09 17:11:07 +00:00
Gorka Eguileor
3c7a71e607 Add error messages to conditional updates devref
There was no mention in conditional updates devref on what kind of error
messages are we expected to return with conditional updates and why we
decided to go with generic errors instead of specific errors like we had
before.

Change-Id: I079a815a656ce5a5c0e05e2e20f26df6ea700547
2016-06-08 10:22:55 +02:00
Jenkins
42db20e90a Merge "Clean up man page and remove version/date" 2016-06-07 14:35:39 +00:00
Eric Brown
d64f5fc210 Clean up man page and remove version/date
This patch fixes the formatting of the man page and removes the
unnecessary maintenance of a date and version.

Change-Id: Idf78bbed44f942bb6976ccf4da67c748d9283ed9
2016-06-06 15:21:47 -07:00
Gorka Eguileor
6f63347eef Fix MySQL DB error in Delete CG
When running a delete CG operation on a MySQL DB engine we'll get an
error from the DB: "You can't specify target table 'consistencygroups'
for update in FROM clause".

This is caused by a non standard behavior only in MySQL, as SQLite and
PostgreSQL work as expected, on filter `cg_creating_from_src` that
checks that we are not using the CG we are trying to delete to create
another CG at this very moment, CGs that were previously created from
this CG are not considered.

This patch changes the way we perform the filter using a select subquery
as a workaround for MySQL unexpected behavior and updates devref to warn
about this unexpected MySQL behavior.

Change-Id: Ic10de411ffeceb00f1e8525906995bd8b2f49777
Closes-Bug: #1588487
2016-06-06 14:27:37 +02:00
Sean McGinnis
fcd7fcea3e Add sample config file to cinder docs
The oslo sphinxconfiggen module was added to the oslo.config
2.3.0 release. This enables config file generation as part of
the sphinx doc generation.

The generated config file will pick up the current config
options from the code base. And as an added bonus, it will
now be published to the docs.openstack.org site for easy
reference or download.

This also puts us inline with what other projects like Nova
are doing for sample config files and is the recommended
method from the Oslo team.

Change-Id: I912a97eb2686d3dc56e50d8641d7bd930179bc18
2016-05-17 08:52:21 -05:00
scottda
5e9a76e47f Make api_microversion_dev more explicit
Include information regarding both minimum and maximum versions
of the API microversion.

Change-Id: Ie3acdcbf323af40bdb4f3ff20fcf2d3e8eb9606d
Closes-Bug: #1582460
2016-05-17 07:28:26 -06:00
Gorka Eguileor
e4fb5aae59 Add devref for conditional updates
This patch adds developer's documentation for conditional update
functionality used to remove API races.

Change-Id: I63ce1c87f7418feba94479b461a4488d4ae6e48c
2016-05-05 18:07:14 +02:00
Alex Meade
53cfde43b8 User messages API for error cases
This patch implements basic user messages with the following APIs.
GET /messages
GET /messages/<message_id>
DELETE /messages/<message_id>

Implements : blueprint summarymessage

Co-Authored-By: Alex Meade <mr.alex.meade@gmail.com>
Co-Authored-By: Sheel Rana <ranasheel2000@gmail.com>

Change-Id: Id8a4a700c1159be24b15056f401a2ea77804d0a0
2016-04-29 18:41:10 +00:00
Atsushi SAKAI
efac539b91 Fix 20 typos on devref
specifiy    => specify
mulit-part  => multi-part
analagous   => analogous
driver.intialize_connection => driver.initialize_connection
succesfully => successfully
Analagous   => Analogous
responsiblity => responsibility
standaredized => standardized
replciation => replication
speicfied   => specified
desireable  => desirable
occurr      => occur
transfered  => transferred
migraton    => migration
streching   => stretching
Documenation => Documentation

Change-Id: Id531e35457f592cccd963ae8b7d50553c7ffb62d
2016-04-22 18:29:36 +09:00
Sean McGinnis
8b24dc676e Fix minor typos in the migration devref
Noticed a few trivial typos while looking through the migration
devref that could be fixed up. Some larger rewording might help
clarify some things, but this just fixes some specific instances.

Change-Id: I24c59f8b1725c8c5c93101983e7a3c4dc2a91065
2016-04-17 16:38:15 -05:00
Danny Al-Gaaf
1323339d33 Fix doc and source documentation errors and warning
Solve warnings and errors from build_sphinx. Fix rst doc files
and source code docstring issues.

Closes-Bug: #1557047

Change-Id: Ib59df2681c98716c786ff0edf6d7cfcc3e8fe5ec
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2016-04-14 12:30:08 +02:00
Jenkins
3c4b65afc6 Merge "Doc: Remove incorrect run_tests.sh documentation" 2016-04-14 03:21:32 +00:00
Jenkins
12e21ac806 Merge "Fix doc build if git is absent" 2016-04-13 21:12:26 +00:00
Tom Fifield
5559c390e8 Launchpad Answers no longer used
This devref page was still sending folks to the long-unused
Launchpad Answer site. Patch updates to inform the reader
that Ask OpenStack may be a better bet these days.

Change-Id: I8b2e2379c1300822d9cddab225835de6d2d8fa80
2016-04-13 21:59:42 +08:00
Thomas Bechtold
e7f55be9a9 Fix doc build if git is absent
When building packages if git is absent, then we should not set
html_last_updated_fmt. It can still be set via the -D switch
when building with sphinx-build.

Change-Id: Ib289335198b0fe0a00922cbfe5c7fd7ff438ffcf
Closes-Bug: #1552251
2016-04-13 09:37:31 +02:00
binean
7bf45429d0 Doc: Remove incorrect run_tests.sh documentation
run_test.sh don't accept --nologcapture , so we'd better remove
the relevant statement.

Change-Id: Id6289972c0bfa3d42e92c7ffd8457427b38a81fe
2016-04-12 16:58:29 +00:00
Jenkins
281ddeb03f Merge "Fix typos in Cinder files" 2016-04-05 21:40:53 +00:00
Anh Tran
6cf076779d Fix typos in Cinder files
Change-Id: I10ddf4a771a11527f977f9829ff353157d742f8e
2016-03-30 06:19:17 +00:00
scottda
41506ab231 python34 tests don't run without python3-dev
We cannot run py34 unit tests without python3-dev, but we
also cannot add this to test-requirements.txt. The best we
can do is add the issue to the devref/unit_tests.rst to help
people find and fix the issue.

Change-Id: I5ff3fef979ca35f2fc4c1c512382f338f586ce51
Closes-Bug: #1563533
2016-03-29 14:56:33 -06:00
Eric Harney
e940d3d929 Docs: Add genconfig to devref toc
Change-Id: Ib6df95eaae24c1962e84d346fa8df57efa033f57
2016-03-22 12:06:13 -04:00
Jenkins
dab8d53cd7 Merge "Add devref on rolling upgrades" 2016-03-16 18:20:18 +00:00
Michał Dulko
aeeff1393d Add devref on rolling upgrades
This is just for upstream developers, docs for operators should follow.

Related-Blueprint: rpc-object-compatibility

Change-Id: I7f9c7dc1d76f5d32c45e00a9e4da37323d927d3a
2016-03-16 12:44:59 +01:00
scottda
ef7ed8dcb2 support new HTTP microversion header
According to API working group guidelines:
https://review.openstack.org/#/c/243414

microversion headers should be of the form:
OpenStack-API-Version: [SERVICE_TYPE] 2.114

i.e OpenStack-API-Version: volume 3.22

Two extra headers are always returned in the response:

    OpenStack-API-Version: [SERVICE_TYPE] version_number
    Vary: OpenStack-API-Version

note: Servers must be prepared to deal with multiple
  OpenStack-API-Version headers. This could happen when a client
  designed to address multiple services always sends the headers it
  thinks it needs. Most Python frameworks will handle this by setting
  the value of the header to the values of all matching headers,
  joined by a ',' (comma). For example ``compute 2.11,identity
  2.114``.

Closes-Bug: #1551941
Change-Id: I658e54966c390b41e3b551dd9827606c2e013511
2016-03-04 09:02:34 -07:00
Jenkins
38a1d36175 Merge "Add attach/detach doc to index" 2016-03-03 08:34:36 +00:00
Jenkins
9fed43a8f0 Merge "doc: Fix wrong description about adding RESTful API" 2016-03-02 23:31:38 +00:00
John Griffith
ea7a9820fd Add attach/detach doc to index
Doesn't do much good to add a doc if you never add it
to the index and remove spurious headers that cause it
to not publish.

This patch fixes those problems.

Change-Id: I5c1906a30539e7223f5cee8ce14a013005fe004d
2016-03-02 12:30:56 -07:00
Andreas Jaeger
5abb3d6ce6 Remove unused pngmath sphinx extension
The extension is not used, remove it.

Change-Id: I0720058e8d2235772b5bb82224b68b1b52e6060d
2016-02-28 20:38:22 +01:00
Jenkins
18229c4c68 Merge "Add basic workflow of attach/detach to devref" 2016-02-28 16:09:13 +00:00
John Griffith
9906ea1ed7 Add basic workflow of attach/detach to devref
This is something that confuses folks and isn't centrally
located.  So... add it to the devref docs and hope that
developers read it.

There's tons of detail we can add in the future of course,
but this at least clears up some of the common misconceptions
that exist currently.

Change-Id: Ic5fb8da06d18fac3369a91a525accc75c1d28100
2016-02-26 21:24:29 +00:00
John Griffith
106c14a84b Replication v2.1 (Cheesecake)
This focuses the replication work on a specific use case,
and eliminates some of the ambiguity in earlier versions.

Additionally this implementation addresses needs for
devices that do replication based on the whole backend-device
or on Pools.

Use case:
  DR scenario, where a storage device is rendered inoperable.
  This implementation allows the preservation of user data
  for those volumes that are of type replication-enabled.

  The goal is NOT to make failures completely transparent
  but instead to preserve data access while an Admin tries
  to rebuild/recover his/her cloud.

It's very important to note that we're no longer interested in
dealing with replication in Cinder at a Volume level.  The concept
of have "some" volumes failover, and "others" left behind, proved
to not only be overly complex and difficult to implement, but we
never identified a concrete use-case where one would use failover
in a scenario where some volumes would stay and be accessible on
a primary but other may be moved and accessed via a secondary.

In this model, it's host/backend based.  So when you failover,
you're failing over an entire backend.  We heavily leverage
existing resources, specifically services, and capabilities.

Implements: blueprint replication-update

Change-Id: If862bcd18515098639f94a8294a8e44e1358c52a
2016-02-26 13:15:19 -07:00
scottda
6b11d276d1 cinder-api-microversions code
Many changes to the Cinder REST API require changes to the consumers of the API.
For example, If we need to add a required parameter to a method that is called
 by Nova, we'd need both the Nova calling code and the cinderclient that
Nova uses to change. But newer Cinder versions with the change must work with
older Nova versions, and there is no mechanism for this at the moment. Adding
microversions will solve this problem.
With microversions, the highest supported version will be negotiated by a field
in the HTTP header that is sent to the Cinder API. In the case where the field
'versions' is not sent (i.e. clients and scripts that pre-date this change),
then the lowest supported version would be used. In order to ensure that the
API consumer is explicitly asking for a microversioned API, a new endpoint v3
is added, which is identical to API version v2. This means that our new
Cinder API v3 would be the default, and consumers of the API that wished to
use a newer version could do so by using that endpoint and a microversion in
the HTTP header.
New tests for microversioned API features on endpoint /v3 should be added to
cinder/tests/unit/api/v3/ directory. Existing functionality will be tested via
the .../v2/ unit tests.

DocImpact
APIImpact
Implements: https://blueprints.launchpad.net/cinder/+spec/cinder-api-microversions
Change-Id: I48cdbbc900c2805e59ee9aebc3b1c64aed3212ae
2016-02-24 06:50:54 -07:00
ChangBo Guo(gcb)
acdbdd377c doc: Fix wrong description about adding RESTful API
* Replace wrong example
* Remove outdated description about serialization

Change-Id: I1da230ce3b1979a0a337fc50d105de5f78f995bc
2016-02-17 10:32:53 +08:00
Harshada Mangesh Kakad
3fa4b8003a Replace deprecated library function os.popen() with subprocess
os.popen() is deprecated since version 2.6. Resolved with use of
subprocess module.

Change-Id: I4d0044c110c32f87ac0316a7e665e2bb9ea88813
Partial-Bug: #1529836
2016-01-06 09:36:45 -08:00