19537 Commits

Author SHA1 Message Date
Yadiel Xuan(轩艳东)
8088dc9580 Prohibit volume manage to an encrypted volume type
Managing a volume to an encrypted volume type should not be allowed.
One reason is that there is no way for an operator to specify an
encryption key ID for the volume. Another is that we already don't
allow a volume of an encrypted type to be un-managed, so this change
will be symmetric.

Also update and correct the api-ref for this call.

Co-authored-by: Yadiel Xuan(轩艳东) <xuanyandong@inspur.com>
Co-authored-by: Brian Rosmaita <rosmaita.fossdev@gmail.com>

Change-Id: Ic2da41f3962c1108f974aca952bce3da6d6ac277
Closes-bug: #1944577
2022-03-21 11:48:01 -04:00
8537730c8c Add Python3 zed unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for zed.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ibb94c28c788ae26fbbc553f08c32b6bf84ac3707
2022-03-14 09:30:14 +00:00
fcf8ab1d8f Update master for stable/yoga
Add file to the reno documentation build to show release notes for
stable/yoga.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/yoga.

Sem-Ver: feature
Change-Id: I0204daab831d56dffcb41fb3775b9b6a917c0f5a
2022-03-14 09:30:09 +00:00
Brian Rosmaita
b69353b6c8 Add yoga release note prelude
Also update the max microversion for yoga in the api version
history document.

Change-Id: I0573499b6d4141d3739033d3af5dbfec681fa908
2022-03-11 09:11:43 -05:00
Zuul
9a8f867321 Merge "lightos - bugfix compression stats should be True" 2022-03-10 21:53:20 +00:00
Zuul
4819adbda6 Merge "Specify yoga os-brick in requirements" 2022-03-10 19:58:51 +00:00
yuval brave
c04e2084f3 lightos - bugfix compression stats should be True
the compression value in get_volume_stats should be ["True", "False"]
and not dependent on the
configuration: "lightos_default_compression_enabled"
if the flag is false, we can not create volume type with
compression=True. the backend is filtered in the scheduler.

Closes-Bug: #1962221

Signed-off-by: Yuval Brave  <yuval@lightbitslabs.com>
Change-Id: I09fe872eca1b112f67bad7297de5893696f83373
2022-03-10 18:36:41 +02:00
Zuul
6a8f7c1edf Merge "Doc: IBM FlashSystem family update in IBM Spectrum Virtualize user guide" 2022-03-10 14:16:19 +00:00
Zuul
556691e65e Merge "Hitachi: Add Target Port Assignment for VSP Driver" 2022-03-09 23:54:10 +00:00
Zuul
b2578e12e2 Merge "db: Preserve API signatures" 2022-03-09 20:02:15 +00:00
Zuul
e8ad14365d Merge "mypy: RBD driver" 2022-03-09 16:18:46 +00:00
Zuul
14bb923793 Merge "RBD driver: clean up _trash_purge exception handling" 2022-03-09 16:18:42 +00:00
Zuul
0539b975fb Merge "fix 'huawei dorado v6' FC initiator can be added to host" 2022-03-09 16:18:37 +00:00
Stephen Finucane
9e261bf1a4 db: Increase timeout for migration tests
We're seeing quite a few timeout failures on the following tests in
'cinder.tests.unit.db.test_migrations':

- TestModelsSyncMySQL.test_models_sync
- TestMigrationsWalkMySQL.test_walk_versions

Currently, this is mainly affecting the AArch64 CI but as we saw in
nova, it's possible for this to have an impact on other underpowered CI
hosts. Like nova change I82b9a064d77251945ff1ae99d7049f367ddde92e, we
now set 'TIMEOUT_SCALING_FACTOR' for these tests to 4, meaning these
tests will now get 240 seconds (or 4 minutes) to execute (we set
OS_TEST_TIMEOUT to 60 in 'tox.ini'). As discussed in that change, there
are other ways we could address this but this seems the most sensible
approach to take.

Change-Id: Iaab4984ed5d4cc8d02ef934a0c6f5980a0fb4687
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2022-03-08 21:30:13 +00:00
Zuul
1088f06d4e Merge "db: Move utility methods to top of file" 2022-03-08 15:51:16 +00:00
Zuul
82e6ada531 Merge "docs: Remove unnecessary 'blockstorage-' prefix" 2022-03-08 15:45:44 +00:00
Zuul
a803c275c1 Merge "db: Enable auto-generation of database migrations" 2022-03-08 15:45:40 +00:00
manishladdha
634c81e697 Doc: IBM FlashSystem family update in IBM Spectrum
Virtualize user guide

This change is in order to include all of the new
products that are coming out for SVC 8.5.0.0

Change-Id: I3d798f0f880b4cccec918807acfcce7f70d7d1d7
2022-03-08 07:40:21 +00:00
Atsushi Kawai
1678260539 Hitachi: Add Target Port Assignment for VSP Driver
Defining particular ports in extra spec "hbsd:target_ports"
determines which of the ports specified by the hitachi_target_ports
or the hitachi_compute_target_ports parameters are used to create LUN
paths during volume attach operations for each volume type.

Implements: blueprint hitachi-vsp-tgt-port-asgn
Change-Id: I2e8d80261fa797c8f3c83c078c29cf1173d46c3c
2022-03-08 04:55:10 +00:00
Zuul
b1fd778cc8 Merge "docs: Rework and move upgrades guide" 2022-03-08 02:16:13 +00:00
Zuul
c7f700db9c Merge "docs: Add whereto for testing redirect rules" 2022-03-08 00:37:57 +00:00
Zuul
6f9d180443 Merge "db: Add tests to ensure we keep migrations in sync" 2022-03-08 00:18:15 +00:00
Zuul
382c9f86d0 Merge "Hitachi: Support AIX as host OS type" 2022-03-07 17:04:01 +00:00
Zuul
121b77cfb6 Merge "db: Resolve additional migration-model mismatches" 2022-03-07 16:52:04 +00:00
Brian Rosmaita
a74513db9a Specify yoga os-brick in requirements
Some of the yoga backend drivers require the yoga os-brick release.
Also update other requirements to match the minima requested by
os-brick (since that's what we'll have to use anyway).

The os-brick requirements were updated by change Iec14833ab502.

Change-Id: I694d01bcdd2ea83627d375cc4501bff774fa82c2
2022-03-07 11:39:01 -05:00
Atsushi Kawai
5c48b6fc32 Hitachi: Support AIX as host OS type
This patch support AIX as host OS type for the Hitachi VSP driver.
When running "cinder attachment-create" command with the option "--ostype aix",
"AIX" is set as host OS type.

Implements: blueprint hitachi-vsp-aix-os-type
Change-Id: Ia3378099789f13d60ba3657d1d3a626e7bc9dced
2022-03-04 02:09:57 +00:00
Atsushi Kawai
11d26b9f59 Hitachi: bugfix and refactoring for add maintenance parameters
This patch is bugfixing and refactoring for the following patch:
https://review.opendev.org/c/openstack/cinder/+/786873

Fixing:
- Adding get_driver_options(), to hbsd_fc.py/hbsd_iscsi.py, which was
 commented in https://review.opendev.org/c/openstack/cinder/+/815614/
- Fixing help massages by commented in hbsd_rest.py
- Fixing error messages for the parameters "hitachi_target_ports" and
 "hitachi_compute_target_ports" to support OEM driver code
 in hbsd_common.py

Refactoring:
- Fixing to not change ALL_CAPS variables and to use config values
 directly by commented in hbsd_rest.py

Change-Id: Id0a4ff9d6a1846a714f23c05c607a8809470978d
2022-03-04 01:50:22 +00:00
bingyan
bb15d83b5f fix 'huawei dorado v6' FC initiator can be added to host
change the fc initiator filter conditions. we add a config
min_fc_ini_online when the number of online fc initiator
more than the min_fc_ini_online, the online initiator will
added to host

Closes-Bug: #1942218
Change-Id: Idb284e3b5f1b9b427a390f1e105f890ce5d49992
2022-03-03 21:23:15 +08:00
Zuul
b49fb59a6b Merge "Remove attach and detach volume driver methods" 2022-03-02 19:21:56 +00:00
Zuul
fab51b6af0 Merge "Move nimble driver code to hpe folder" 2022-03-02 11:54:20 +00:00
Zuul
c7135ca1f0 Merge "Tests: Fix missing novaclient context arg in test_host_filters" 2022-03-01 22:58:36 +00:00
Zuul
07424f0fcc Merge "db: Add missing foreign keys, indexes to models" 2022-03-01 19:07:11 +00:00
Eric Harney
d94f1381c1 Tests: Fix missing novaclient context arg in test_host_filters
This triggers a pylint failure.

Change-Id: I6b7122197fa31866658f5889491c607ed905424f
2022-03-01 10:50:03 -05:00
Zuul
ef08a0eb30 Merge "Reset state robustification for volume os-reset_status" 2022-03-01 14:39:48 +00:00
Zuul
a43427ef57 Merge "db: Remove unnecessary timezone configuration" 2022-03-01 00:42:50 +00:00
Zuul
2cdabb6a97 Merge "[SVf] Manage host attachment using portsets" 2022-03-01 00:13:24 +00:00
haailani
88fd602edd [SVf] Manage host attachment using portsets
[Spectrum Virtualize family] Providing support to IBM Storwize cinder
driver to use portsets to manage host attachment, backend storage
connectivity and IP replication traffic.
Portsets are groupings of logical addresses that are associated with
specific traffic types. Portsets are created on the storage. Hosts are
then created using the portset info given by the admin.

Implements: blueprint ibm-svf-portset

Change-Id: I38c9889bff2d18d3dadd49f28b8436a77b131a22
2022-02-28 08:57:25 +00:00
tushargite96
61f1179c00 Reset state robustification for volume os-reset_status
This commit changes the os-reset_status volume-api
to handle the below use cases
1.Can not reset volume to "ing" states

2.available volume reset to in-use - 400

The _reset_status method is override in VolumeAdminController class
to handle different volume states.

NOTE: with this change, some requests that previously succeeded will
return a 400.  However, these were requests that would leave a resource
in an inconsistent state with an inaccurate status, so a 400 is
appropriate.  We use a 400 (not 409) to be consistent with the current
Block Storage API. This change is not microversioned because it doesn't
make sense to only prevent operators from shooting themselves in the
foot if they happen to specify an appropriate microversion,
and be grievously wounded otherwise.

Partial implement blueprint reset-state-robustification

API state reference sheet
https://wiki.openstack.org/wiki/Reset_State_Robustification

Change-Id: I0a53dfee61dc6372dce53445d4b252304c83c58a
2022-02-28 10:54:22 +05:30
whoami-rajat
fedd9b1459 Followup: Address review comments on re-image patch
This is a followup patch to address review comments on change
I031aae50ee82198648f46c503bba04c6e231bbe5.

Change-Id: I38884b313ea63ff76bc65c41580343226a128ae8
2022-02-24 22:58:53 +05:30
Yikun Jiang
d69e89ea3b Support volume re-image
This patch adds volume re-image API to enable the ability to
re-image a specific volume.

Implements: blueprint add-volume-re-image-api

Co-Authored-by: Rajat Dhasmana <rajatdhasmana@gmail.com>

Change-Id: I031aae50ee82198648f46c503bba04c6e231bbe5
2022-02-24 15:23:38 +05:30
Zuul
55ea01c1d0 Merge "Fix request id mess on Cinder-API" 2022-02-24 01:31:30 +00:00
whoami-rajat
171894c7f5 Add missing microversion entry for 3.67
Change I3729cbe1902ab4dc335451d13ed921ec236fb8fd merged
implementing microversion 3.67 but missed an entry in
the microversions.py file.
This patch addresses the same.

Change-Id: Ifd30ee86e657ddda9746eddcd080557520b1d468
2022-02-23 23:03:24 +05:30
Gorka Eguileor
18b8033b6b Fix request id mess on Cinder-API
This patch fixes multiple issues related to request ids:

- Duplicated request ID in logs
- Missing request id header in response
- Wrong request ID in response header when using noauth

The source of these issues is the fact that the request ID and the
request context are set too late, or not at all, in the paste filter
chain.

And the last bug is fixed as a freebie when the code in auth.py is
refactored to reduce code duplication on setting the cinder.context key
in the request's environment.

The patch fixes these issue by changing the filter chains to have the
request_id filter as the first filter, and using our own filter for it,
to ensure that the context is correctly set.

Not sure if values now defined in ENV_OVERWRITES are still necessary,
so the patch preserves current behavior.

Closes-Bug: #1960019
Closes-Bug: #1960020
Closes-Bug: #1960021
Closes-Bug: #1960329
Change-Id: Ide831a221a7561bbb7da193f0edb011f1989420e
2022-02-23 16:48:45 +01:00
Zuul
5b89039e9e Merge "Remove the need for project_id from API endpoints" 2022-02-23 15:40:46 +00:00
Zuul
627d117fab Merge "[SVf] RevertToSnapshot for rep-volumes in group" 2022-02-22 15:38:15 +00:00
Stephen Finucane
369af76f88 db: Preserve API signatures
Change-Id: I5542e17936739ef4271cae480b9d955fd3df758e
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2022-02-20 19:57:47 +00:00
Stephen Finucane
001b0e43dd db: Move utility methods to top of file
This helps distinguish them from the actual DB API methods that we'd use
to e.g. populate objects and will simplify the merging of 'nova.db.api'
and 'nova.db.sqlalchemy.api'.

Change-Id: I5f7a8359bddb3cb9951ef6f9e80243a61e5374aa
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2022-02-20 19:06:33 +00:00
Stephen Finucane
52370e58fe docs: Remove unnecessary 'blockstorage-' prefix
These are in the cinder doc tree so of course they're block
storage-related.

Change-Id: Ic1950ff89021a89de397619eef17f8100eb3d847
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2022-02-20 19:06:32 +00:00
Stephen Finucane
31f8ad4eb4 db: Enable auto-generation of database migrations
Alembic does lots of new things. Provide docs for how to use this. This
doesn't actually work that well at the moment because it appears our
database migrations are not in sync with the models. Those issues will
have to be resolved separately.

Change-Id: I6645ca951114b94ce9ed5a83e5e11d53879a7cd5
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2022-02-20 19:06:01 +00:00
Stephen Finucane
0d7f3ba862 docs: Rework and move upgrades guide
This shouldn't be in the root of the docs: it's not easily discoverable
and it doesn't belong there. We also modify the header style to better
match the OpenStack style guide [1] and set things up for a future guide
on writing database migrations.

[1] https://docs.openstack.org/doc-contrib-guide/rst-conv/titles.html#cg-titles

Change-Id: I277b9ad8d275aa21d2c3ce478d2a30e4f6e5f0ba
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2022-02-20 19:06:00 +00:00